-- Logs begin at Wed 2022-08-24 02:45:46 UTC, end at Wed 2022-08-24 04:06:48 UTC. -- Aug 24 03:25:33.930537 dv-cinder-854262-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 03:25:33.940985 dv-cinder-854262-1-smb devstack@keystone.service[81843]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:25:33 2022] *** Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: nodename: dv-cinder-854262-1-smb Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: machine: x86_64 Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: clock source: unix Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: pcre jit disabled Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: detected number of CPU cores: 4 Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: current working directory: / Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: your processes number limit is 47680 Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: your memory page size is 4096 bytes Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: detected max file descriptor number: 2048 Aug 24 03:25:33.941563 dv-cinder-854262-1-smb devstack@keystone.service[81843]: lock engine: pthread robust mutexes Aug 24 03:25:33.943029 dv-cinder-854262-1-smb devstack@keystone.service[81843]: thunder lock: enabled Aug 24 03:25:33.943029 dv-cinder-854262-1-smb devstack@keystone.service[81843]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 03:25:33.943029 dv-cinder-854262-1-smb devstack@keystone.service[81843]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:25:33.981326 dv-cinder-854262-1-smb devstack@keystone.service[81843]: Python main interpreter initialized at 0x55ff0f3729c0 Aug 24 03:25:33.981326 dv-cinder-854262-1-smb devstack@keystone.service[81843]: python threads support enabled Aug 24 03:25:33.981326 dv-cinder-854262-1-smb devstack@keystone.service[81843]: your server socket listen backlog is limited to 100 connections Aug 24 03:25:33.981326 dv-cinder-854262-1-smb devstack@keystone.service[81843]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:25:33.981684 dv-cinder-854262-1-smb devstack@keystone.service[81843]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:25:33.981766 dv-cinder-854262-1-smb devstack@keystone.service[81843]: *** Operational MODE: preforking *** Aug 24 03:25:33.982021 dv-cinder-854262-1-smb devstack@keystone.service[81843]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:25:33.982021 dv-cinder-854262-1-smb devstack@keystone.service[81843]: spawned uWSGI master process (pid: 81843) Aug 24 03:25:33.982225 dv-cinder-854262-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 03:25:33.982804 dv-cinder-854262-1-smb devstack@keystone.service[81843]: spawned uWSGI worker 1 (pid: 81854, cores: 1) Aug 24 03:25:33.987068 dv-cinder-854262-1-smb devstack@keystone.service[81843]: spawned uWSGI worker 2 (pid: 81855, cores: 1) Aug 24 03:25:33.987068 dv-cinder-854262-1-smb devstack@keystone.service[81843]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:25:38.389522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:38.389522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: from cryptography.utils import int_from_bytes Aug 24 03:25:38.390364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:38.390364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: from cryptography.utils import int_from_bytes Aug 24 03:25:38.393819 dv-cinder-854262-1-smb devstack@keystone.service[81854]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:38.393819 dv-cinder-854262-1-smb devstack@keystone.service[81854]: from cryptography.utils import int_from_bytes Aug 24 03:25:38.394299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:38.394299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: from cryptography.utils import int_from_bytes Aug 24 03:25:38.444303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:25:38.444490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:25:38.444670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] command line args: [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:25:38.444918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:25:38.445007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:25:38.445115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ================================================================================ {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:25:38.445193 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:25:38.445308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] command line args: [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:25:38.445395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] admin_token = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.445583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:25:38.445670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] config_dir = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.445747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ================================================================================ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:25:38.445818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.445952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] config_source = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.446038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] admin_token = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.446118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] debug = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.446247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] config_dir = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.446325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.446564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.446629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] config_source = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.446691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.446830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] debug = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.446941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.447078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.447231 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.447341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.447463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.447590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.447691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.447794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.447900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_config_append = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.447996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.448102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.448102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_dir = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.448291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.448393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_file = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.448499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_config_append = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.448499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.448672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.448797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_dir = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.448874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.449042 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.449199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.449282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.449353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.449430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.449507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.449507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.449687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.449767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.449844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.449923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.450064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.450154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.450233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.450366 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.450446 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.450600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.450723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.450837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.450914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.451096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.454888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.454976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.88/identity {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] publish_errors = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455744 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.88/identity {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] publish_errors = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.455991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456060 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] standard_threads = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456252 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] standard_threads = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456675 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] use_journal = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456737 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] use_json = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] use_stderr = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.456959 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] use_syslog = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.457030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.457030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] use_journal = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.457131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.457192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] use_json = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.457250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.457379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] use_stderr = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.457439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.457496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] use_syslog = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.457552 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.457608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:38.457670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.457734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.457792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.457849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.457910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.457967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458259 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.458934 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.459798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.459928 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.460066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.460198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.460342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.460473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.460632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.460763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.460888 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.461027 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.461168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.461302 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.461431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.461558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.461686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.461817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.461956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.462084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.462211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.462338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.462465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.462600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.462830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.462967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.463164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.463243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.463314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.463396 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.463483 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.463558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.463635 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.463706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.463777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.463855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.463927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464151 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464527 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464897 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.464967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465196 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.465972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.466130 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.466209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.466382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.466481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.466618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.466727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.466852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.466959 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.467089 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.467211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.467323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.467425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.467553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.467662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.467804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.467910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.468041 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.468149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.468280 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.468385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.468515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.468620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.468792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.468899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.469031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.469136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.469271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.469383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.469497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.469596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.469738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.469846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.469961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.470060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.470203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.470318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.470431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.470528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.471991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.472140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.472140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.472354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.472454 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.472574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.472661 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.472735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.472816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.472898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.472972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473407 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.473929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474076 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.474993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.475093 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.475169 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.475246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.475333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.475444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.475531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.475875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.475976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.476052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.476136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.476211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.476283 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.476399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.476480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.476668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.476754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.476918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.477000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.477162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.477241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.477399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.477487 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.477637 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.477717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.477874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.477953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.478130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.478230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.478348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.478427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.478594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.478674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.478834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.478923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.479089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.479173 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.479335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.483425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.483425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.483606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.483673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.483733 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.483792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.483850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.483919 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.483978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.external = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484397 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.password = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484550 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.external = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] auth.token = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.484971 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.password = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] auth.token = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.485961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486266 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486441 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486799 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.486983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487441 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.487962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.488034 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.488112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.488183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.488253 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.488323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.488392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.488572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.488663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.488817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.488906 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.489073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.489240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.489330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.489486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.489567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.489742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.489821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.489980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.490059 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.490234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.490320 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.490478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.490556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.490732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.490837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.491038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.491181 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.491257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.491329 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.491464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.491556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.491707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.491797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.491946 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.492026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.492199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.492286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.492448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.492531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.492682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.492761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.492918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.493007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.493154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.493234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.493389 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.493468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.493634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.493722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.493883 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.493962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.494136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.494216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.494377 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.494465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.494617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.494698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.494881 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.494984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.495137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.495269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.495373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.495530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.495610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.495788 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.495875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.496060 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.496142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.496305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.496385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.496549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.496629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.496803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.496884 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.497040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.497120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.497274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.497353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.497519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.497601 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.497755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.497834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.497995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.498075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.498244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.498326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.498476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.498560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.498716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.498796 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.498951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.499033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.499213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.499295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.499454 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.499542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.499696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.499834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.500537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.500678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.500793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.500926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.501018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.501093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.501248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.501351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.501488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.501592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.501734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.501836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.501979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.502090 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.502229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.502344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.502477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.502585 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.502723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.502825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.502980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.503099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.503263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.503347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.503501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.503582 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.503738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.503818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.503993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.504075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.504246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.504326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.504492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.504586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.504732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.504824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.504968 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.505047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.505202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.505294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.505439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.505522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.505679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.505827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.505907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.506078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.506161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.506336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.506422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.506591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.506684 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.506844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.506961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.507126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.507238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.507338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.507434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.507578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.507678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.507829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.507917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.508071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.508151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.508313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.508395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.508553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.508634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.508793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.508873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.509042 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.509123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.509292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.509371 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.509534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.509615 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.509768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.509849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.510015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.510094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.510256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.510335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.510494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.510589 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.510735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.510822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.510977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.511077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.511253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.511338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.511499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.511580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.511742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.511821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.511981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.512061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.512226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.512308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.512474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.512552 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.512718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.512800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.512954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.513033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.513195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.513290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.513447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.513551 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.513697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.513793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.513935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.514021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.514177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.514262 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.514417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.514496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.514658 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] role.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.514737 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.514909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.514995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] role.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.515163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.515245 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.515417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.515497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.516237 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.516320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.516486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.516557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.516779 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.516855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.517035 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.517156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.517280 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.517349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.517527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] role.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.517596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.517776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.517845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] role.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.518012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.518080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.518258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.518338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.518510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.518590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.518759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.518838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.519009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.519174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.519294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.519468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.519549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.519708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.519789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.519961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.520045 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.520213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.520293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.520463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.520543 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.520715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.520797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.520950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.521031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.521207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.521287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.521462 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.521633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.521713 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.521878 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.521958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.522136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.522224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.522371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.522449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.522625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.522705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.522876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.522969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.523147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.523235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.523396 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.523489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.523638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.523722 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.523874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.523954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.524110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.524188 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.524346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.524426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.524581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.524665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.524842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.524941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.525067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.525150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.525317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.525398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.525557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.525638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.525801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.525881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.526033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.526111 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.526283 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.526358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.526523 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.526645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.526762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.526841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.527000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.527099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.527274 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.527358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.527526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.527604 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.527756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.527834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.528003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.528084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.528248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.528327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.528504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.528584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.connection = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.528748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.528837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.528994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.529076 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.529236 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.529322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.529476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.529555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.529717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.529798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.529949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.530048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.530196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.530275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.530410 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.530534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.530658 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.530804 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.530893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.531089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.531224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.531386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.531466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.531591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.531672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.531841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.531921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.532085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.532166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.532323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.532402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.532563 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.532641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.532798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.532878 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.532971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:25:38.533052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.533276 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.533527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.533770 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.534024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.534266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.534517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.534756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.535003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.535288 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:38.535464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:25:38.563802 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.563802 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.564046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.565531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.565769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.566004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.572458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.574610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.600837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.601069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.601529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.601768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.677910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.678064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.727438 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.727674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.728941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.729189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.892192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.892418 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.892644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.892867 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.893012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.893121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.893250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.893332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.893478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.893703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.893927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.894147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.921957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.922182 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.922408 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.922489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.922632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.922715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.922851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.922932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.923098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.923247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.923336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.923414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.923518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.923736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.934556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.934854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.947843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.948077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.948304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.948500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.948611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.948732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.948814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.948951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.949034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.949168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81855) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.949253 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.949380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.949594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.949811 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81854) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:38.973989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.974192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:38.974534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.974708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.974794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:38.974924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:38.975028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.975273 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.975356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.975483 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:38.975763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.975861 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.976031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.976114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.976551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.976820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.986379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.986658 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.986932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.987246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.987598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.987884 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.996628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.996628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.996821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:38.996895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:38.997381 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:38.997670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.997993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.998282 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.998567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.998832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.998914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:38.999138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.999226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.999422 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.999504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.999713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:38.999808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.000031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.000114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.000299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.000382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.000577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.000859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.001257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.001542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.001821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.023683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.025166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.025446 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.025662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.027180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.027477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.030220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.030508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.030795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.032921 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.033207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.033494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.037824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.038115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.040211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.040505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.042299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.042594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.042879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.043192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.043479 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.043833 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.044068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.044342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.044825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.045124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.045414 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.045703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.045984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.046375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.046658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.047515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.062669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.062960 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.065497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.065786 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.066921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.069820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.070241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.070545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.073226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.073664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.074892 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.077978 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.078144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.081360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.081460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.081759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.082051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.088303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.088303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.088303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.088505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.088505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.088505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.088505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.088505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.088505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.099608 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.099907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.100177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.100452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.103674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.103980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.104252 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.104531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.107478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.109011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.109354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.112108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.112393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.112683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.112977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.113276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.113555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.113639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.113929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.116653 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.116947 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.117245 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.117625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.117942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.125663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.125952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.126255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.126530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.126798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.127110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.127397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.130250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.130574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.130865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.131177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.131466 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.131756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.132372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.143248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.146333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.148489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.149307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.150763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.151682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.152286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.152569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.152865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.154662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.156691 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.158282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.158659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.158897 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.160072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.161559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.164570 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.164859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.165144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.165429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.171324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.171324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.171324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.171324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.171324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.171324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.173632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.173931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.174218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.182030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81855) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.182177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.182315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.182475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.182599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.182764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.182884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.183189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.183468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.183744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.184037 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.184319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.184638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.184884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.185150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.185428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.185700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81855) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.190688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81854) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:39.190979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.191295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.191585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.191872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.192151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.192429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.192780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.193067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.193344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.193637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.193916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.194228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.194505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81854) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:39.221572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff0f3729c0 pid: 81855 (default app) Aug 24 03:25:39.225064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cab092-6868-47e7-aed1-95d89292ffdd None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.225357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cab092-6868-47e7-aed1-95d89292ffdd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.225634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cab092-6868-47e7-aed1-95d89292ffdd None None] PATH_INFO: `/v3` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.229817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 791 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.230531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff0f3729c0 pid: 81854 (default app) Aug 24 03:25:46.814419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938b315-4135-42e8-b94f-faebbf69385b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.814985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938b315-4135-42e8-b94f-faebbf69385b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.814985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938b315-4135-42e8-b94f-faebbf69385b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.816314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 2/2] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:46.825192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d16a-d324-4544-893d-48568b4ff855 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.825629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d16a-d324-4544-893d-48568b4ff855 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.825755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d16a-d324-4544-893d-48568b4ff855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.897741 dv-cinder-854262-1-smb devstack@keystone.service[81854]: INFO dbcounter [None req-0354d16a-d324-4544-893d-48568b4ff855 None None] Registered counter for database keystone Aug 24 03:25:46.919385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG oslo_db.sqlalchemy.engines [None req-0354d16a-d324-4544-893d-48568b4ff855 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:25:46.925606 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writer thread running {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:25:47.106329 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG passlib.handlers.bcrypt [None req-0354d16a-d324-4544-893d-48568b4ff855 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81854) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 03:25:47.106674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG passlib.handlers.bcrypt [None req-0354d16a-d324-4544-893d-48568b4ff855 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81854) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 03:25:47.161284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0354d16a-d324-4544-893d-48568b4ff855 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:47.162927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0354d16a-d324-4544-893d-48568b4ff855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:47.291941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1/3] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 03:25:47.605855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938b315-4135-42e8-b94f-faebbf69385b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.675623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: INFO dbcounter [None req-b938b315-4135-42e8-b94f-faebbf69385b None None] Registered counter for database keystone Aug 24 03:25:47.695388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG oslo_db.sqlalchemy.engines [None req-b938b315-4135-42e8-b94f-faebbf69385b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:25:47.701571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writer thread running {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:25:47.826706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938b315-4135-42e8-b94f-faebbf69385b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:47.831115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ba20f-9087-40e2-bc6f-2748e98ee0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:47.831754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ba20f-9087-40e2-bc6f-2748e98ee0cf admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.832038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ba20f-9087-40e2-bc6f-2748e98ee0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.832311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ba20f-9087-40e2-bc6f-2748e98ee0cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.840642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ba20f-9087-40e2-bc6f-2748e98ee0cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:47.894287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: WARNING keystone.common.rbac_enforcer.enforcer [None req-112ba20f-9087-40e2-bc6f-2748e98ee0cf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 03:25:47.894640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ba20f-9087-40e2-bc6f-2748e98ee0cf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:47.904723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 3/4] 10.222.0.88 () {58 vars in 1324 bytes} [Wed Aug 24 03:25:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:25:47.911198 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d16a-d324-4544-893d-48568b4ff855 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.926467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d16a-d324-4544-893d-48568b4ff855 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:47.930986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda47bf-e2a3-4dc0-bda1-ddc5e535a04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:47.932121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda47bf-e2a3-4dc0-bda1-ddc5e535a04f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.932413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda47bf-e2a3-4dc0-bda1-ddc5e535a04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.932692 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda47bf-e2a3-4dc0-bda1-ddc5e535a04f admin admin] PATH_INFO: `/v3/projects/8ee2c938bc0d4468aba227f5962adcb7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.934144 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda47bf-e2a3-4dc0-bda1-ddc5e535a04f admin admin] RBAC: Authorizing `identity:get_project(project_id=8ee2c938bc0d4468aba227f5962adcb7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:47.990887 dv-cinder-854262-1-smb devstack@keystone.service[81854]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2cda47bf-e2a3-4dc0-bda1-ddc5e535a04f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 03:25:47.991261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda47bf-e2a3-4dc0-bda1-ddc5e535a04f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:47.995906 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 2/5] 10.222.0.88 () {56 vars in 1207 bytes} [Wed Aug 24 03:25:47 2022] GET /identity/v3/projects/8ee2c938bc0d4468aba227f5962adcb7 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:49.869936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dca49-bf5c-4d9a-b043-b616ca34495d None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.870339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dca49-bf5c-4d9a-b043-b616ca34495d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.870489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dca49-bf5c-4d9a-b043-b616ca34495d None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.875233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 4/6] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:25:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:49.880960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6b41-a66a-4020-9b1a-ba1d08ecbd11 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.881341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6b41-a66a-4020-9b1a-ba1d08ecbd11 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.881521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6b41-a66a-4020-9b1a-ba1d08ecbd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.901262 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3a4b6b41-a66a-4020-9b1a-ba1d08ecbd11 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:49.902805 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3a4b6b41-a66a-4020-9b1a-ba1d08ecbd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:49.910784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 3/7] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 03:25:50.181286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dca49-bf5c-4d9a-b043-b616ca34495d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.193387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dca49-bf5c-4d9a-b043-b616ca34495d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.197575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877c63a-11f0-40fb-bc49-c6ee107970ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.198175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c63a-11f0-40fb-bc49-c6ee107970ee admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.198459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c63a-11f0-40fb-bc49-c6ee107970ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.198734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c63a-11f0-40fb-bc49-c6ee107970ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.206360 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877c63a-11f0-40fb-bc49-c6ee107970ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:50.208185 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877c63a-11f0-40fb-bc49-c6ee107970ee admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:50.216886 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 5/8] 10.222.0.88 () {58 vars in 1324 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:25:50.222826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b6b41-a66a-4020-9b1a-ba1d08ecbd11 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.231984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b6b41-a66a-4020-9b1a-ba1d08ecbd11 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.237251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d025f5-7c93-4f64-9e64-a97f5736f4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.237883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d025f5-7c93-4f64-9e64-a97f5736f4cb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.238174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d025f5-7c93-4f64-9e64-a97f5736f4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.238456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d025f5-7c93-4f64-9e64-a97f5736f4cb admin admin] PATH_INFO: `/v3/users/360b6abf2f0e4fd18bda140d1e9c6378` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.239821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d025f5-7c93-4f64-9e64-a97f5736f4cb admin admin] RBAC: Authorizing `identity:get_user(user_id=360b6abf2f0e4fd18bda140d1e9c6378)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:50.241651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d025f5-7c93-4f64-9e64-a97f5736f4cb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:50.243222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 4/9] 10.222.0.88 () {56 vars in 1198 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/users/360b6abf2f0e4fd18bda140d1e9c6378 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.224594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3836b-53c1-4cb4-9fc4-d47ec306f3ac None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.225198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3836b-53c1-4cb4-9fc4-d47ec306f3ac None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.225198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3836b-53c1-4cb4-9fc4-d47ec306f3ac None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.226486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 6/10] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:52.231727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26397f61-48d3-421e-a234-ccfe887b4398 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.232151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26397f61-48d3-421e-a234-ccfe887b4398 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.232318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26397f61-48d3-421e-a234-ccfe887b4398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.251355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-26397f61-48d3-421e-a234-ccfe887b4398 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:52.252554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-26397f61-48d3-421e-a234-ccfe887b4398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:52.280911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5560-4ad9-4994-bc1d-a256803d3348 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.281203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5560-4ad9-4994-bc1d-a256803d3348 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.281483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf5560-4ad9-4994-bc1d-a256803d3348 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.282813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 7/11] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:52.287984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b676c-c55f-4e16-ad1f-43ead20ab141 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.288276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b676c-c55f-4e16-ad1f-43ead20ab141 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.288554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b676c-c55f-4e16-ad1f-43ead20ab141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.330514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG passlib.handlers.bcrypt [None req-bc0b676c-c55f-4e16-ad1f-43ead20ab141 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81855) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 03:25:52.330944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG passlib.handlers.bcrypt [None req-bc0b676c-c55f-4e16-ad1f-43ead20ab141 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81855) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 03:25:52.332178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 5/12] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:52.377246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bc0b676c-c55f-4e16-ad1f-43ead20ab141 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:52.378825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bc0b676c-c55f-4e16-ad1f-43ead20ab141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:52.476900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 8/13] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:52.625127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26397f61-48d3-421e-a234-ccfe887b4398 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.648908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.729344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26397f61-48d3-421e-a234-ccfe887b4398 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.743318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b676c-c55f-4e16-ad1f-43ead20ab141 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.764217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d2449-bef4-465a-9df2-090bdbf66135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.765383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d2449-bef4-465a-9df2-090bdbf66135 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.765687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d2449-bef4-465a-9df2-090bdbf66135 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.765961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d2449-bef4-465a-9df2-090bdbf66135 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.777294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d2449-bef4-465a-9df2-090bdbf66135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-8e5d2449-bef4-465a-9df2-090bdbf66135 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:52.786715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:52.787922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:52.788826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:25:52.791179 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 6/14] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:25:52.793529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d2449-bef4-465a-9df2-090bdbf66135 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.854362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b676c-c55f-4e16-ad1f-43ead20ab141 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.856743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.880647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.893018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b945a-b0bc-4d07-93e3-cda07fa8e818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.893956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b945a-b0bc-4d07-93e3-cda07fa8e818 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.894197 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b945a-b0bc-4d07-93e3-cda07fa8e818 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.894472 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b945a-b0bc-4d07-93e3-cda07fa8e818 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.898896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d2449-bef4-465a-9df2-090bdbf66135 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08564a72-48d1-4d3b-8083-161f86c576a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.932708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08564a72-48d1-4d3b-8083-161f86c576a6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08564a72-48d1-4d3b-8083-161f86c576a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.933270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08564a72-48d1-4d3b-8083-161f86c576a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.933954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08564a72-48d1-4d3b-8083-161f86c576a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:52.934272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08564a72-48d1-4d3b-8083-161f86c576a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.936221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08564a72-48d1-4d3b-8083-161f86c576a6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.948370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 7/15] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:52.954520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08564a72-48d1-4d3b-8083-161f86c576a6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.963583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b945a-b0bc-4d07-93e3-cda07fa8e818 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.965119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b945a-b0bc-4d07-93e3-cda07fa8e818 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.053933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08564a72-48d1-4d3b-8083-161f86c576a6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.065776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 9/16] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:25:53.071303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b945a-b0bc-4d07-93e3-cda07fa8e818 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.073978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.088585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff33c-7ac0-438f-92bb-96ad46502323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.089228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff33c-7ac0-438f-92bb-96ad46502323 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.092988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff33c-7ac0-438f-92bb-96ad46502323 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.092988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff33c-7ac0-438f-92bb-96ad46502323 None admin] PATH_INFO: `/v3/users/360b6abf2f0e4fd18bda140d1e9c6378` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.092988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff33c-7ac0-438f-92bb-96ad46502323 None admin] RBAC: Authorizing `identity:get_user(user_id=360b6abf2f0e4fd18bda140d1e9c6378)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.092988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff33c-7ac0-438f-92bb-96ad46502323 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.094037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 8/17] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/users/360b6abf2f0e4fd18bda140d1e9c6378 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:53.099461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff33c-7ac0-438f-92bb-96ad46502323 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.115595 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.169288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b945a-b0bc-4d07-93e3-cda07fa8e818 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.202577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f578-0b87-4fdf-8bc9-0fb8b173370a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.202916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff33c-7ac0-438f-92bb-96ad46502323 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.203456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f578-0b87-4fdf-8bc9-0fb8b173370a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.203736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f578-0b87-4fdf-8bc9-0fb8b173370a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.204009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f578-0b87-4fdf-8bc9-0fb8b173370a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.222993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6f578-0b87-4fdf-8bc9-0fb8b173370a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.224498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6f578-0b87-4fdf-8bc9-0fb8b173370a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.237168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6724e0-149c-4680-8a21-297c9fc033af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.237800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6724e0-149c-4680-8a21-297c9fc033af None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.238084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6724e0-149c-4680-8a21-297c9fc033af None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.238361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6724e0-149c-4680-8a21-297c9fc033af None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.239533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6724e0-149c-4680-8a21-297c9fc033af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.241005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6724e0-149c-4680-8a21-297c9fc033af None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.242567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 9/18] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-bce6f578-0b87-4fdf-8bc9-0fb8b173370a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:25:53.243450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:53.244694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:25:53.245494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:25:53.245494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:53.245494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:25:53.245494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 10/19] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:25:53.248317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6724e0-149c-4680-8a21-297c9fc033af None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.250236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f578-0b87-4fdf-8bc9-0fb8b173370a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.314538 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.340258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.358979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f578-0b87-4fdf-8bc9-0fb8b173370a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.359163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6724e0-149c-4680-8a21-297c9fc033af None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.394053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c778520-5033-447c-9ecd-542960fc1525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.394603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f2f1c-8740-4756-bb63-d016f564894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.394743 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c778520-5033-447c-9ecd-542960fc1525 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.394931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c778520-5033-447c-9ecd-542960fc1525 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.395240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f2f1c-8740-4756-bb63-d016f564894f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.395350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c778520-5033-447c-9ecd-542960fc1525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.395523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f2f1c-8740-4756-bb63-d016f564894f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.395797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f2f1c-8740-4756-bb63-d016f564894f None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.395963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c778520-5033-447c-9ecd-542960fc1525 None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.domain.id=default, user.id=360b6abf2f0e4fd18bda140d1e9c6378) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:53.396270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c778520-5033-447c-9ecd-542960fc1525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.396558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f2f1c-8740-4756-bb63-d016f564894f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:53.396869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f2f1c-8740-4756-bb63-d016f564894f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.397865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c778520-5033-447c-9ecd-542960fc1525 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.398251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f2f1c-8740-4756-bb63-d016f564894f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.404930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 10/20] 10.222.0.88 () {56 vars in 1322 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/role_assignments?user.id=360b6abf2f0e4fd18bda140d1e9c6378&scope.domain.id=default&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:53.416387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 11/21] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:55.753557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de0cb5-3e69-49af-a5c1-1be80251262f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.754645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de0cb5-3e69-49af-a5c1-1be80251262f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.755160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de0cb5-3e69-49af-a5c1-1be80251262f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.756712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 11/22] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:55.762248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf500e2-b327-4125-afb3-c632780f21bb None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.763152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf500e2-b327-4125-afb3-c632780f21bb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.763625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf500e2-b327-4125-afb3-c632780f21bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.788099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4cf500e2-b327-4125-afb3-c632780f21bb None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:55.789760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4cf500e2-b327-4125-afb3-c632780f21bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:55.859151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85c0d2-09ad-48a9-8ded-1db1075c7e9d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.859482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85c0d2-09ad-48a9-8ded-1db1075c7e9d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.859718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85c0d2-09ad-48a9-8ded-1db1075c7e9d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.861385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 12/23] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:55.872656 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea231e-c81b-4e8a-9914-5f0599ae6963 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.872950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea231e-c81b-4e8a-9914-5f0599ae6963 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.873227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea231e-c81b-4e8a-9914-5f0599ae6963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.905634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 12/24] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:55.914360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bdea231e-c81b-4e8a-9914-5f0599ae6963 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:55.915123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee8630-d247-487a-b50b-7bcd873acf74 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.915595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee8630-d247-487a-b50b-7bcd873acf74 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.915817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bdea231e-c81b-4e8a-9914-5f0599ae6963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:55.916250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee8630-d247-487a-b50b-7bcd873acf74 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.917757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 13/25] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:55.930150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07397133-2590-4135-98d7-0d9cda875210 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.930759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07397133-2590-4135-98d7-0d9cda875210 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.931280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07397133-2590-4135-98d7-0d9cda875210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.959984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-07397133-2590-4135-98d7-0d9cda875210 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:55.961208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-07397133-2590-4135-98d7-0d9cda875210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:56.040881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 13/26] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:56.046209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d83b-7457-4835-b390-1a2740b443d4 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.046503 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d83b-7457-4835-b390-1a2740b443d4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.046787 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d83b-7457-4835-b390-1a2740b443d4 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.048094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 14/27] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:25:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:56.055914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4230f-6431-43b3-93ed-6d9465a3e47c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.056197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4230f-6431-43b3-93ed-6d9465a3e47c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.056479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4230f-6431-43b3-93ed-6d9465a3e47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.059459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.085960 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 14/28] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:56.088926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1bf4230f-6431-43b3-93ed-6d9465a3e47c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:56.090128 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1bf4230f-6431-43b3-93ed-6d9465a3e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:56.207409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 15/29] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:56.258999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07397133-2590-4135-98d7-0d9cda875210 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.365918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4230f-6431-43b3-93ed-6d9465a3e47c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.372601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.398617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07397133-2590-4135-98d7-0d9cda875210 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.460136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d869e2-8273-4067-bc81-8c0e66705dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.461101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d869e2-8273-4067-bc81-8c0e66705dec None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.461395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d869e2-8273-4067-bc81-8c0e66705dec None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.462062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d869e2-8273-4067-bc81-8c0e66705dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.478004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d869e2-8273-4067-bc81-8c0e66705dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.479525 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d869e2-8273-4067-bc81-8c0e66705dec None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-94d869e2-8273-4067-bc81-8c0e66705dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:25:56.504406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:56.505327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:25:56.506133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:25:56.506133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:56.506133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:25:56.506133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 15/30] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:56.512649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d869e2-8273-4067-bc81-8c0e66705dec None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.569691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.605197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4230f-6431-43b3-93ed-6d9465a3e47c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.679080 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98989e-1949-4237-bec7-dd70c81c6dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.680326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98989e-1949-4237-bec7-dd70c81c6dac None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.680797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98989e-1949-4237-bec7-dd70c81c6dac None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.681500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98989e-1949-4237-bec7-dd70c81c6dac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.695674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98989e-1949-4237-bec7-dd70c81c6dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5f98989e-1949-4237-bec7-dd70c81c6dac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:56.703425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:56.704285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:56.705052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:25:56.705627 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d869e2-8273-4067-bc81-8c0e66705dec None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.708227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 16/31] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:25:56.709286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98989e-1949-4237-bec7-dd70c81c6dac None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.750782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882de3-1fde-4700-951e-92f53ed24d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.751880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882de3-1fde-4700-951e-92f53ed24d6c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.752306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882de3-1fde-4700-951e-92f53ed24d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.752694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882de3-1fde-4700-951e-92f53ed24d6c None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.753444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882de3-1fde-4700-951e-92f53ed24d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:56.753847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882de3-1fde-4700-951e-92f53ed24d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.756636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882de3-1fde-4700-951e-92f53ed24d6c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.771980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 16/32] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:56.772778 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882de3-1fde-4700-951e-92f53ed24d6c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.792604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.854639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98989e-1949-4237-bec7-dd70c81c6dac None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.887917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.901213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882de3-1fde-4700-951e-92f53ed24d6c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.907893 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19964-e298-40c4-b8e0-205e6c1882c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.908518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19964-e298-40c4-b8e0-205e6c1882c4 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.908804 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19964-e298-40c4-b8e0-205e6c1882c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.909084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19964-e298-40c4-b8e0-205e6c1882c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.909766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb19964-e298-40c4-b8e0-205e6c1882c4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.911690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb19964-e298-40c4-b8e0-205e6c1882c4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.941788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edc3cc-b062-4b64-8874-ee540f58ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.942437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edc3cc-b062-4b64-8874-ee540f58ad17 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.942791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edc3cc-b062-4b64-8874-ee540f58ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.943174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edc3cc-b062-4b64-8874-ee540f58ad17 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.943916 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edc3cc-b062-4b64-8874-ee540f58ad17 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.945434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edc3cc-b062-4b64-8874-ee540f58ad17 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.111349 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 17/33] 10.222.0.88 () {60 vars in 1131 bytes} [Wed Aug 24 03:25:56 2022] POST /identity/v3/roles => generated 219 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:57.112374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19964-e298-40c4-b8e0-205e6c1882c4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.183549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 17/34] 10.222.0.88 () {60 vars in 1131 bytes} [Wed Aug 24 03:25:56 2022] POST /identity/v3/roles => generated 225 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:57.184754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edc3cc-b062-4b64-8874-ee540f58ad17 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.242674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19964-e298-40c4-b8e0-205e6c1882c4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.279446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.296465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5489bc-3ea1-442e-b25b-4d73fe5a04b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.297101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5489bc-3ea1-442e-b25b-4d73fe5a04b9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.297387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5489bc-3ea1-442e-b25b-4d73fe5a04b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.297666 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5489bc-3ea1-442e-b25b-4d73fe5a04b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.298360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5489bc-3ea1-442e-b25b-4d73fe5a04b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:57.298673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5489bc-3ea1-442e-b25b-4d73fe5a04b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.300404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5489bc-3ea1-442e-b25b-4d73fe5a04b9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.312207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 18/35] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:57.314384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca401dc-6b59-46e0-87b9-bceab9001db6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.314384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca401dc-6b59-46e0-87b9-bceab9001db6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.314574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca401dc-6b59-46e0-87b9-bceab9001db6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.316224 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 19/36] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:57.327886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a64e-1621-4cbd-b510-d8ea7d6144fa None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.328169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a64e-1621-4cbd-b510-d8ea7d6144fa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.328443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a64e-1621-4cbd-b510-d8ea7d6144fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.351529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f1b2a64e-1621-4cbd-b510-d8ea7d6144fa None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:57.353771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f1b2a64e-1621-4cbd-b510-d8ea7d6144fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:57.358836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edc3cc-b062-4b64-8874-ee540f58ad17 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.409101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ded39-7f81-46f8-b2b7-a5159526e29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.409730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ded39-7f81-46f8-b2b7-a5159526e29e None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.410016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ded39-7f81-46f8-b2b7-a5159526e29e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.410294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ded39-7f81-46f8-b2b7-a5159526e29e None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.411637 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ded39-7f81-46f8-b2b7-a5159526e29e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.413889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ded39-7f81-46f8-b2b7-a5159526e29e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.447159 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 20/37] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:57.452522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a64e-1621-4cbd-b510-d8ea7d6144fa None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.541823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.549300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 18/38] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:25:57 2022] POST /identity/v3/projects => generated 301 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:57.559432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b3a40-3b39-42ab-b8fc-891980304f35 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.560543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b3a40-3b39-42ab-b8fc-891980304f35 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.561070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b3a40-3b39-42ab-b8fc-891980304f35 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.563909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 19/39] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:25:57 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:57.571101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a64e-1621-4cbd-b510-d8ea7d6144fa None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.573031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82323c-3481-428c-89db-8337d1ca42b2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.578732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82323c-3481-428c-89db-8337d1ca42b2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.578732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82323c-3481-428c-89db-8337d1ca42b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.593978 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.596094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5b82323c-3481-428c-89db-8337d1ca42b2 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:57.598236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5b82323c-3481-428c-89db-8337d1ca42b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:57.619961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92991a6-a973-4293-b1fd-901544f70dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.621313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92991a6-a973-4293-b1fd-901544f70dbf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.621842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92991a6-a973-4293-b1fd-901544f70dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.622336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92991a6-a973-4293-b1fd-901544f70dbf None admin] PATH_INFO: `/v3/users/360b6abf2f0e4fd18bda140d1e9c6378` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.624408 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92991a6-a973-4293-b1fd-901544f70dbf None admin] RBAC: Authorizing `identity:get_user(user_id=360b6abf2f0e4fd18bda140d1e9c6378)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.628042 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92991a6-a973-4293-b1fd-901544f70dbf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.630981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 21/40] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/users/360b6abf2f0e4fd18bda140d1e9c6378 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:57.639354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92991a6-a973-4293-b1fd-901544f70dbf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.687312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 20/41] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:57.751224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82323c-3481-428c-89db-8337d1ca42b2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.761821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92991a6-a973-4293-b1fd-901544f70dbf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.882690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82323c-3481-428c-89db-8337d1ca42b2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.910775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767a5c2-e1f6-43cf-af66-792fcc36d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.911452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a5c2-e1f6-43cf-af66-792fcc36d482 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.911738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a5c2-e1f6-43cf-af66-792fcc36d482 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.912070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a5c2-e1f6-43cf-af66-792fcc36d482 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.913149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767a5c2-e1f6-43cf-af66-792fcc36d482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.914609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767a5c2-e1f6-43cf-af66-792fcc36d482 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.914991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.916438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 22/42] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:57.921698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c2dff-93a9-4fe3-b970-0ba1356361d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.922319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c2dff-93a9-4fe3-b970-0ba1356361d6 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.922506 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767a5c2-e1f6-43cf-af66-792fcc36d482 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.932614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c2dff-93a9-4fe3-b970-0ba1356361d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.932614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c2dff-93a9-4fe3-b970-0ba1356361d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.932614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c2dff-93a9-4fe3-b970-0ba1356361d6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.932614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c2dff-93a9-4fe3-b970-0ba1356361d6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.976681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:58.014978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 21/43] 10.222.0.88 () {60 vars in 1131 bytes} [Wed Aug 24 03:25:57 2022] POST /identity/v3/roles => generated 223 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:25:58.015845 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c2dff-93a9-4fe3-b970-0ba1356361d6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:58.028822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767a5c2-e1f6-43cf-af66-792fcc36d482 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.082659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f7650-cf4a-4e88-b707-0d338829e6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.083398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f7650-cf4a-4e88-b707-0d338829e6ed None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.083694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f7650-cf4a-4e88-b707-0d338829e6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.083984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f7650-cf4a-4e88-b707-0d338829e6ed None admin] PATH_INFO: `/v3/domains/default/users/360b6abf2f0e4fd18bda140d1e9c6378/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.086090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f7650-cf4a-4e88-b707-0d338829e6ed None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=360b6abf2f0e4fd18bda140d1e9c6378, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.087685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f7650-cf4a-4e88-b707-0d338829e6ed None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.138178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c2dff-93a9-4fe3-b970-0ba1356361d6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.153486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 23/44] 10.222.0.88 () {58 vars in 1361 bytes} [Wed Aug 24 03:25:57 2022] PUT /identity/v3/domains/default/users/360b6abf2f0e4fd18bda140d1e9c6378/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:25:58.178261 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208516a2-26cf-4078-b2d9-786e7e3fe3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.178937 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208516a2-26cf-4078-b2d9-786e7e3fe3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.179250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208516a2-26cf-4078-b2d9-786e7e3fe3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.179527 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208516a2-26cf-4078-b2d9-786e7e3fe3e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.181439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208516a2-26cf-4078-b2d9-786e7e3fe3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.182947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208516a2-26cf-4078-b2d9-786e7e3fe3e1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.184851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 22/45] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:58.190548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f7650-cf4a-4e88-b707-0d338829e6ed None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:58.305607 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f7650-cf4a-4e88-b707-0d338829e6ed None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.319313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:58.340646 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43274b1d-7be7-4450-90b4-231c49f04e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.341265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43274b1d-7be7-4450-90b4-231c49f04e39 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.341553 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43274b1d-7be7-4450-90b4-231c49f04e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.341833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43274b1d-7be7-4450-90b4-231c49f04e39 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.342794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43274b1d-7be7-4450-90b4-231c49f04e39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.344132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43274b1d-7be7-4450-90b4-231c49f04e39 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.455624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 24/46] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:25:58 2022] POST /identity/v3/projects => generated 312 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:00.074815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfe810-b716-4eef-b55c-825c833c2cae None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.075392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfe810-b716-4eef-b55c-825c833c2cae None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.075392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfe810-b716-4eef-b55c-825c833c2cae None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.076798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 23/47] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:00.082903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7a415-8c3b-46d1-b82f-8be0efd8af5f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.083361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7a415-8c3b-46d1-b82f-8be0efd8af5f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.083514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7a415-8c3b-46d1-b82f-8be0efd8af5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.102649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-88d7a415-8c3b-46d1-b82f-8be0efd8af5f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:00.103984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-88d7a415-8c3b-46d1-b82f-8be0efd8af5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:00.171443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 25/48] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:00.355625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516131bf-1f75-4021-bef7-f50db97e0585 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.355933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516131bf-1f75-4021-bef7-f50db97e0585 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.356204 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516131bf-1f75-4021-bef7-f50db97e0585 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.357568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 24/49] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:00.363700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917f25-2e6a-4252-9595-d350326497ec None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.363997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917f25-2e6a-4252-9595-d350326497ec None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.364279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917f25-2e6a-4252-9595-d350326497ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.382797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2f917f25-2e6a-4252-9595-d350326497ec None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:00.384044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2f917f25-2e6a-4252-9595-d350326497ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:00.445479 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516131bf-1f75-4021-bef7-f50db97e0585 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.450706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 26/50] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:00.504374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.559834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516131bf-1f75-4021-bef7-f50db97e0585 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.594317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16ef4e-c942-4879-a4ed-1a58a5f40221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.594946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ef4e-c942-4879-a4ed-1a58a5f40221 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.595272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ef4e-c942-4879-a4ed-1a58a5f40221 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.595553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16ef4e-c942-4879-a4ed-1a58a5f40221 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.606574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16ef4e-c942-4879-a4ed-1a58a5f40221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-8a16ef4e-c942-4879-a4ed-1a58a5f40221 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:00.614489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:00.615628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:00.616389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 25/51] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:00.621412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f917f25-2e6a-4252-9595-d350326497ec None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.646365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.721694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f917f25-2e6a-4252-9595-d350326497ec None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.722515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16ef4e-c942-4879-a4ed-1a58a5f40221 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.758350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35416914-8184-42cf-9f83-aafc3844ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.758990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416914-8184-42cf-9f83-aafc3844ef6a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.759309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416914-8184-42cf-9f83-aafc3844ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.759590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416914-8184-42cf-9f83-aafc3844ef6a None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.760288 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35416914-8184-42cf-9f83-aafc3844ef6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:00.760601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35416914-8184-42cf-9f83-aafc3844ef6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.762062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35416914-8184-42cf-9f83-aafc3844ef6a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.771520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 27/52] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:00.777580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35416914-8184-42cf-9f83-aafc3844ef6a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.875532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.891318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35416914-8184-42cf-9f83-aafc3844ef6a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.926376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f3792-dc8a-43b7-ab00-cbc56a7cb938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.927020 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3792-dc8a-43b7-ab00-cbc56a7cb938 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.927341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3792-dc8a-43b7-ab00-cbc56a7cb938 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.927631 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f3792-dc8a-43b7-ab00-cbc56a7cb938 None admin] PATH_INFO: `/v3/users/360b6abf2f0e4fd18bda140d1e9c6378` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.928785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f3792-dc8a-43b7-ab00-cbc56a7cb938 None admin] RBAC: Authorizing `identity:get_user(user_id=360b6abf2f0e4fd18bda140d1e9c6378)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.930254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f3792-dc8a-43b7-ab00-cbc56a7cb938 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.931897 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 28/53] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/users/360b6abf2f0e4fd18bda140d1e9c6378 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:00.937418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f3792-dc8a-43b7-ab00-cbc56a7cb938 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.937828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16ef4e-c942-4879-a4ed-1a58a5f40221 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.954890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.971813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8089d-7c0e-4a2b-8c7f-7e825d4c0ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.972386 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8089d-7c0e-4a2b-8c7f-7e825d4c0ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.972667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8089d-7c0e-4a2b-8c7f-7e825d4c0ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.972941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8089d-7c0e-4a2b-8c7f-7e825d4c0ee5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.974104 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8089d-7c0e-4a2b-8c7f-7e825d4c0ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.976149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8089d-7c0e-4a2b-8c7f-7e825d4c0ee5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.977938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 26/54] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:00.984120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8089d-7c0e-4a2b-8c7f-7e825d4c0ee5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.038793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f3792-dc8a-43b7-ab00-cbc56a7cb938 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.072407 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a31f7-53b6-42b7-87d3-5a10f9931882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.073049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a31f7-53b6-42b7-87d3-5a10f9931882 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.073393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a31f7-53b6-42b7-87d3-5a10f9931882 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.073677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a31f7-53b6-42b7-87d3-5a10f9931882 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.074826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a31f7-53b6-42b7-87d3-5a10f9931882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.076343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a31f7-53b6-42b7-87d3-5a10f9931882 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.078468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 29/55] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:01.084369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a31f7-53b6-42b7-87d3-5a10f9931882 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.084919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8089d-7c0e-4a2b-8c7f-7e825d4c0ee5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.108932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.119324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67638bf-42fd-4933-8cb9-99a5698695cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.119931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67638bf-42fd-4933-8cb9-99a5698695cc None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.120216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67638bf-42fd-4933-8cb9-99a5698695cc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.120494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67638bf-42fd-4933-8cb9-99a5698695cc None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.121151 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67638bf-42fd-4933-8cb9-99a5698695cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.122632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67638bf-42fd-4933-8cb9-99a5698695cc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.184500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a31f7-53b6-42b7-87d3-5a10f9931882 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.218306 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457904bf-386d-4c85-a4d9-0a44070dcf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.218908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457904bf-386d-4c85-a4d9-0a44070dcf5c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.219217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457904bf-386d-4c85-a4d9-0a44070dcf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.219496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457904bf-386d-4c85-a4d9-0a44070dcf5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.220218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457904bf-386d-4c85-a4d9-0a44070dcf5c None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.domain.id=default, user.id=360b6abf2f0e4fd18bda140d1e9c6378) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:01.220527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457904bf-386d-4c85-a4d9-0a44070dcf5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.222029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457904bf-386d-4c85-a4d9-0a44070dcf5c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.227577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 30/56] 10.222.0.88 () {56 vars in 1322 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/role_assignments?user.id=360b6abf2f0e4fd18bda140d1e9c6378&scope.domain.id=default&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:01.251459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 27/57] 10.222.0.88 () {60 vars in 1140 bytes} [Wed Aug 24 03:26:00 2022] POST /identity/v3/projects => generated 298 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:26:03.168581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2659c-1fb5-4c3c-abed-3830812331d5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.169069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2659c-1fb5-4c3c-abed-3830812331d5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.169069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2659c-1fb5-4c3c-abed-3830812331d5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.170517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 31/58] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:03.175902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6177e-edf9-4c4d-9edf-93c3ff8c52df None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.176317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6177e-edf9-4c4d-9edf-93c3ff8c52df None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.176458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6177e-edf9-4c4d-9edf-93c3ff8c52df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.198265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d5d6177e-edf9-4c4d-9edf-93c3ff8c52df None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:03.199497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d5d6177e-edf9-4c4d-9edf-93c3ff8c52df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:03.229769 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:03.266432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 28/59] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:03.532873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2659c-1fb5-4c3c-abed-3830812331d5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:03.618028 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:03.633150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2659c-1fb5-4c3c-abed-3830812331d5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:03.667061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614add4d-33ec-4282-958a-1ec4f610c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:03.667697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614add4d-33ec-4282-958a-1ec4f610c861 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.667981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614add4d-33ec-4282-958a-1ec4f610c861 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.668258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614add4d-33ec-4282-958a-1ec4f610c861 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.669377 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614add4d-33ec-4282-958a-1ec4f610c861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:03.671427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614add4d-33ec-4282-958a-1ec4f610c861 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:03.672989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 32/60] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:03.678484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6177e-edf9-4c4d-9edf-93c3ff8c52df None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:03.775398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6177e-edf9-4c4d-9edf-93c3ff8c52df None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:03.809180 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f0b1f-18c5-4379-bfe0-4ced99d89b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:03.809721 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0b1f-18c5-4379-bfe0-4ced99d89b92 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.810006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0b1f-18c5-4379-bfe0-4ced99d89b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.810284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0b1f-18c5-4379-bfe0-4ced99d89b92 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.810970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f0b1f-18c5-4379-bfe0-4ced99d89b92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:03.812453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f0b1f-18c5-4379-bfe0-4ced99d89b92 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:03.894935 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 29/61] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:03 2022] POST /identity/v3/users => generated 275 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:06.934322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b64602-a4ca-4054-9ea2-3c968d5842c6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.934821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b64602-a4ca-4054-9ea2-3c968d5842c6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.934893 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b64602-a4ca-4054-9ea2-3c968d5842c6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.936855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 33/62] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:06.942233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc3b1-f185-4270-87af-0a4a0671c361 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.943073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc3b1-f185-4270-87af-0a4a0671c361 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.943555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc3b1-f185-4270-87af-0a4a0671c361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.963198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-fe3cc3b1-f185-4270-87af-0a4a0671c361 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:06.964731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fe3cc3b1-f185-4270-87af-0a4a0671c361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:06.981386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9700-9bd5-4f03-b47a-ed0d092cabc2 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.982013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9700-9bd5-4f03-b47a-ed0d092cabc2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.982543 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9700-9bd5-4f03-b47a-ed0d092cabc2 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.984605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 34/63] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:06.988178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:06.990732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56ef4-e13d-41c9-a050-900571d072c2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.991261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56ef4-e13d-41c9-a050-900571d072c2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.991726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56ef4-e13d-41c9-a050-900571d072c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.014295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0ce56ef4-e13d-41c9-a050-900571d072c2 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:07.016576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ce56ef4-e13d-41c9-a050-900571d072c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:07.096284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 35/64] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:07.113308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 30/65] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:07.147430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d5d2f-653d-48cf-9b5c-b5750a5ccbe6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.148008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d5d2f-653d-48cf-9b5c-b5750a5ccbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.148479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d5d2f-653d-48cf-9b5c-b5750a5ccbe6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.150052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 36/66] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:07.165506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b558-c6cf-4c5f-956c-01026702f118 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.166090 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b558-c6cf-4c5f-956c-01026702f118 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.166578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b558-c6cf-4c5f-956c-01026702f118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.191097 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-96e3b558-c6cf-4c5f-956c-01026702f118 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:07.192744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-96e3b558-c6cf-4c5f-956c-01026702f118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:07.284425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 31/67] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:07.395857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d5d2f-653d-48cf-9b5c-b5750a5ccbe6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.431790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3b558-c6cf-4c5f-956c-01026702f118 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.503954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d5d2f-653d-48cf-9b5c-b5750a5ccbe6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.519145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.553490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.558309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c2aa0-7fe0-4bd2-8076-a394bf1f99dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.558968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c2aa0-7fe0-4bd2-8076-a394bf1f99dc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.559287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c2aa0-7fe0-4bd2-8076-a394bf1f99dc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.559566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c2aa0-7fe0-4bd2-8076-a394bf1f99dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.571887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3b558-c6cf-4c5f-956c-01026702f118 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.584201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c2aa0-7fe0-4bd2-8076-a394bf1f99dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ca7c2aa0-7fe0-4bd2-8076-a394bf1f99dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:07.595583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:07.596498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:07.597271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 37/68] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:07.602763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c2aa0-7fe0-4bd2-8076-a394bf1f99dc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.628532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aaf81-619b-4610-9210-c42131c7cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.629241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aaf81-619b-4610-9210-c42131c7cf33 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.629565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aaf81-619b-4610-9210-c42131c7cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.629858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aaf81-619b-4610-9210-c42131c7cf33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.643639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48aaf81-619b-4610-9210-c42131c7cf33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f48aaf81-619b-4610-9210-c42131c7cf33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:07.651300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:07.652174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:07.653021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:07.654078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 32/69] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:07.658765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aaf81-619b-4610-9210-c42131c7cf33 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.710905 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c2aa0-7fe0-4bd2-8076-a394bf1f99dc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.746778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbf668-b999-4a2e-8570-e92e030da99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.747445 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbf668-b999-4a2e-8570-e92e030da99c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.747730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbf668-b999-4a2e-8570-e92e030da99c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.748515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbf668-b999-4a2e-8570-e92e030da99c None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.749211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbf668-b999-4a2e-8570-e92e030da99c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:07.749509 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbf668-b999-4a2e-8570-e92e030da99c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:07.750916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbf668-b999-4a2e-8570-e92e030da99c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:07.759861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 38/70] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:07.765635 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbf668-b999-4a2e-8570-e92e030da99c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.768390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aaf81-619b-4610-9210-c42131c7cf33 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.775143 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.806382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3a4ba-bd81-4354-9c4e-dc60f58018c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.807022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3a4ba-bd81-4354-9c4e-dc60f58018c5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.807341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3a4ba-bd81-4354-9c4e-dc60f58018c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.807624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3a4ba-bd81-4354-9c4e-dc60f58018c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.818369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3a4ba-bd81-4354-9c4e-dc60f58018c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-1ca3a4ba-bd81-4354-9c4e-dc60f58018c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:07.823255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:07.824079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:07.824849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 33/71] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:07.825671 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058dedf-8625-4953-b5c3-c9473ab7c73a None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.825904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058dedf-8625-4953-b5c3-c9473ab7c73a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.826053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058dedf-8625-4953-b5c3-c9473ab7c73a None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.827734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 34/72] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:07.828418 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058dedf-8625-4953-b5c3-c9473ab7c73a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.833642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.877475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbf668-b999-4a2e-8570-e92e030da99c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.911309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb3dff-21ed-4ac2-b43d-b3c5365b3688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.911923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb3dff-21ed-4ac2-b43d-b3c5365b3688 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.912208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb3dff-21ed-4ac2-b43d-b3c5365b3688 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.912486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb3dff-21ed-4ac2-b43d-b3c5365b3688 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.913153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb3dff-21ed-4ac2-b43d-b3c5365b3688 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:07.913461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb3dff-21ed-4ac2-b43d-b3c5365b3688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:07.914905 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb3dff-21ed-4ac2-b43d-b3c5365b3688 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:07.927838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 39/73] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:07.927838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dc9a6-1b18-48e1-b96f-4574f84de93d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.927838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dc9a6-1b18-48e1-b96f-4574f84de93d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.927838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dc9a6-1b18-48e1-b96f-4574f84de93d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.927838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 40/74] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:07.927838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dc9a6-1b18-48e1-b96f-4574f84de93d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.938418 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058dedf-8625-4953-b5c3-c9473ab7c73a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.978063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59b68e-12f9-4b76-936e-2b2f7ecf5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.978679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59b68e-12f9-4b76-936e-2b2f7ecf5ece None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.978909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59b68e-12f9-4b76-936e-2b2f7ecf5ece None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.979214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59b68e-12f9-4b76-936e-2b2f7ecf5ece None admin] PATH_INFO: `/v3/users/360b6abf2f0e4fd18bda140d1e9c6378` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.980609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59b68e-12f9-4b76-936e-2b2f7ecf5ece None admin] RBAC: Authorizing `identity:get_user(user_id=360b6abf2f0e4fd18bda140d1e9c6378)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:07.982099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59b68e-12f9-4b76-936e-2b2f7ecf5ece None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:07.983749 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 35/75] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/users/360b6abf2f0e4fd18bda140d1e9c6378 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:07.985163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc682a-2ea8-466a-ae29-d0101dc824d8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.985451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc682a-2ea8-466a-ae29-d0101dc824d8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.985732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc682a-2ea8-466a-ae29-d0101dc824d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.003560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-35bc682a-2ea8-466a-ae29-d0101dc824d8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:08.004791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-35bc682a-2ea8-466a-ae29-d0101dc824d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:08.010356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.046851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dc9a6-1b18-48e1-b96f-4574f84de93d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.070330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 36/76] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:08.071415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc682a-2ea8-466a-ae29-d0101dc824d8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.073613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.089412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e57468-efee-4328-b1d9-47bec9daa289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.090028 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e57468-efee-4328-b1d9-47bec9daa289 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.090394 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e57468-efee-4328-b1d9-47bec9daa289 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.090652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e57468-efee-4328-b1d9-47bec9daa289 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.091272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e57468-efee-4328-b1d9-47bec9daa289 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:08.091582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e57468-efee-4328-b1d9-47bec9daa289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.093935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e57468-efee-4328-b1d9-47bec9daa289 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.106190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 41/77] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:08.106190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd173f1-3d09-42c5-b96b-050620b1e84b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.106190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd173f1-3d09-42c5-b96b-050620b1e84b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.106190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd173f1-3d09-42c5-b96b-050620b1e84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.124755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4bd173f1-3d09-42c5-b96b-050620b1e84b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:08.126079 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4bd173f1-3d09-42c5-b96b-050620b1e84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:08.191597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc682a-2ea8-466a-ae29-d0101dc824d8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.209942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 42/78] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:08.210814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd173f1-3d09-42c5-b96b-050620b1e84b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.235702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e424b-0361-4507-a889-14d94444310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.236276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e424b-0361-4507-a889-14d94444310d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.236566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e424b-0361-4507-a889-14d94444310d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.236848 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e424b-0361-4507-a889-14d94444310d None admin] PATH_INFO: `/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.255659 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e424b-0361-4507-a889-14d94444310d None admin] RBAC: Authorizing `identity:get_user(user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.257146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e424b-0361-4507-a889-14d94444310d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.263367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 37/79] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:08.263367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e424b-0361-4507-a889-14d94444310d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.307138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.329243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.353690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd173f1-3d09-42c5-b96b-050620b1e84b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.376914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e424b-0361-4507-a889-14d94444310d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.391303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790eec1-788d-4d40-b778-d1eba93570d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.391961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790eec1-788d-4d40-b778-d1eba93570d8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.392253 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790eec1-788d-4d40-b778-d1eba93570d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.392816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790eec1-788d-4d40-b778-d1eba93570d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.416402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711fbdb-26e0-4802-a5a4-6a9f20484a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.417101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711fbdb-26e0-4802-a5a4-6a9f20484a1d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.417390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711fbdb-26e0-4802-a5a4-6a9f20484a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.417673 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711fbdb-26e0-4802-a5a4-6a9f20484a1d None admin] PATH_INFO: `/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.418854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711fbdb-26e0-4802-a5a4-6a9f20484a1d None admin] RBAC: Authorizing `identity:get_user(user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.420365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711fbdb-26e0-4802-a5a4-6a9f20484a1d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.426463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 38/80] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:08.426463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711fbdb-26e0-4802-a5a4-6a9f20484a1d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.472407 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790eec1-788d-4d40-b778-d1eba93570d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.474513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790eec1-788d-4d40-b778-d1eba93570d8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.529111 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711fbdb-26e0-4802-a5a4-6a9f20484a1d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.534259 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.555849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.564067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9a42a-11ac-49ec-8e8f-f29a53e5a4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.564680 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9a42a-11ac-49ec-8e8f-f29a53e5a4ec None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.564964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9a42a-11ac-49ec-8e8f-f29a53e5a4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.565252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9a42a-11ac-49ec-8e8f-f29a53e5a4ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.577024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 43/81] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:08.577871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790eec1-788d-4d40-b778-d1eba93570d8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.631478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9a42a-11ac-49ec-8e8f-f29a53e5a4ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.632971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9a42a-11ac-49ec-8e8f-f29a53e5a4ec None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.676755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790eec1-788d-4d40-b778-d1eba93570d8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.710616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa536b65-0647-4969-8f10-0e2bb534b614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.711281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536b65-0647-4969-8f10-0e2bb534b614 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.711562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536b65-0647-4969-8f10-0e2bb534b614 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.711840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536b65-0647-4969-8f10-0e2bb534b614 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.722783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa536b65-0647-4969-8f10-0e2bb534b614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-aa536b65-0647-4969-8f10-0e2bb534b614 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:08.727610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:08.728602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:08.729446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 44/82] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:08.730075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa536b65-0647-4969-8f10-0e2bb534b614 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.730139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 39/83] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:08.730958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9a42a-11ac-49ec-8e8f-f29a53e5a4ec None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.757414 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.759338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.829608 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9a42a-11ac-49ec-8e8f-f29a53e5a4ec None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.834507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa536b65-0647-4969-8f10-0e2bb534b614 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.865269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9510e-7694-4fa2-9c03-266ef374c4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.865910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9510e-7694-4fa2-9c03-266ef374c4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.866267 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9510e-7694-4fa2-9c03-266ef374c4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.866478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9510e-7694-4fa2-9c03-266ef374c4e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.867624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9510e-7694-4fa2-9c03-266ef374c4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.869082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9510e-7694-4fa2-9c03-266ef374c4e0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.869565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c008742-cd79-45e0-855c-36c2d26ebe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.870171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008742-cd79-45e0-855c-36c2d26ebe4d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.870451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008742-cd79-45e0-855c-36c2d26ebe4d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.870661 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 40/84] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:08.870751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008742-cd79-45e0-855c-36c2d26ebe4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.871547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9510e-7694-4fa2-9c03-266ef374c4e0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.947400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c008742-cd79-45e0-855c-36c2d26ebe4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.948872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c008742-cd79-45e0-855c-36c2d26ebe4d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.968197 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.969536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.973826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9510e-7694-4fa2-9c03-266ef374c4e0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.007306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb88888-c39e-4189-aa61-b02cbdd114a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.007989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb88888-c39e-4189-aa61-b02cbdd114a8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.008217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb88888-c39e-4189-aa61-b02cbdd114a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.008509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb88888-c39e-4189-aa61-b02cbdd114a8 None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.009648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb88888-c39e-4189-aa61-b02cbdd114a8 None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.011139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb88888-c39e-4189-aa61-b02cbdd114a8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.012795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 41/85] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.013572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb88888-c39e-4189-aa61-b02cbdd114a8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.046698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 45/86] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:09.047584 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c008742-cd79-45e0-855c-36c2d26ebe4d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.116349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb88888-c39e-4189-aa61-b02cbdd114a8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.147931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c008742-cd79-45e0-855c-36c2d26ebe4d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.149786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff400f-4463-4106-8a49-a41985df2e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.150400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff400f-4463-4106-8a49-a41985df2e99 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.150686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff400f-4463-4106-8a49-a41985df2e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.150966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff400f-4463-4106-8a49-a41985df2e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.151663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff400f-4463-4106-8a49-a41985df2e99 None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:09.151970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff400f-4463-4106-8a49-a41985df2e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.153472 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff400f-4463-4106-8a49-a41985df2e99 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.166308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 42/87] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.171503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff400f-4463-4106-8a49-a41985df2e99 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.171586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.185740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc742fbe-d50a-4b5e-9205-95819a64e8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.186385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742fbe-d50a-4b5e-9205-95819a64e8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.186676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742fbe-d50a-4b5e-9205-95819a64e8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.186959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742fbe-d50a-4b5e-9205-95819a64e8f5 None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.188142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742fbe-d50a-4b5e-9205-95819a64e8f5 None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.189684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742fbe-d50a-4b5e-9205-95819a64e8f5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.191384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 46/88] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.192167 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc742fbe-d50a-4b5e-9205-95819a64e8f5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.194331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.267238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff400f-4463-4106-8a49-a41985df2e99 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.293419 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc742fbe-d50a-4b5e-9205-95819a64e8f5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.300752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520b832-f1e7-489d-ab4b-0617a977757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.301365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520b832-f1e7-489d-ab4b-0617a977757a None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.301644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520b832-f1e7-489d-ab4b-0617a977757a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.301918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520b832-f1e7-489d-ab4b-0617a977757a None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.302587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520b832-f1e7-489d-ab4b-0617a977757a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.304067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520b832-f1e7-489d-ab4b-0617a977757a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.327285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d3cbf-91bf-487b-ac45-664d01b3f5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.327942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d3cbf-91bf-487b-ac45-664d01b3f5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.328228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d3cbf-91bf-487b-ac45-664d01b3f5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.328505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d3cbf-91bf-487b-ac45-664d01b3f5e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.329244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d3cbf-91bf-487b-ac45-664d01b3f5e8 None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=680354d08b5e4597b80901494f3d923c, user.id=360b6abf2f0e4fd18bda140d1e9c6378) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:09.329558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d3cbf-91bf-487b-ac45-664d01b3f5e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.331004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d3cbf-91bf-487b-ac45-664d01b3f5e8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.336525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 47/89] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/role_assignments?user.id=360b6abf2f0e4fd18bda140d1e9c6378&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.337387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d3cbf-91bf-487b-ac45-664d01b3f5e8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.391170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 43/90] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:09 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:09.397648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.400343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520b832-f1e7-489d-ab4b-0617a977757a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.468959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d3cbf-91bf-487b-ac45-664d01b3f5e8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.516621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33b27d-0fc8-4b02-8cf0-ed85e53da057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.517298 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33b27d-0fc8-4b02-8cf0-ed85e53da057 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.517644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33b27d-0fc8-4b02-8cf0-ed85e53da057 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.517941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33b27d-0fc8-4b02-8cf0-ed85e53da057 None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.519501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33b27d-0fc8-4b02-8cf0-ed85e53da057 None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.521073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33b27d-0fc8-4b02-8cf0-ed85e53da057 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.523105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 48/91] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.523785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33b27d-0fc8-4b02-8cf0-ed85e53da057 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.526818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.552236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520b832-f1e7-489d-ab4b-0617a977757a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.599082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8a16b-6295-48ad-92b0-8c72758432cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.599832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8a16b-6295-48ad-92b0-8c72758432cc None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.600121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8a16b-6295-48ad-92b0-8c72758432cc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.600395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8a16b-6295-48ad-92b0-8c72758432cc None admin] PATH_INFO: `/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.603466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8a16b-6295-48ad-92b0-8c72758432cc None admin] RBAC: Authorizing `identity:get_user(user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.604948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8a16b-6295-48ad-92b0-8c72758432cc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.606597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 44/92] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.611232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8a16b-6295-48ad-92b0-8c72758432cc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.656341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33b27d-0fc8-4b02-8cf0-ed85e53da057 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.682727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.698368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f2273-a7f6-4bba-91e9-bde7a1a5a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.698989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f2273-a7f6-4bba-91e9-bde7a1a5a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.699403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f2273-a7f6-4bba-91e9-bde7a1a5a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.699574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f2273-a7f6-4bba-91e9-bde7a1a5a4c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.700316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f2273-a7f6-4bba-91e9-bde7a1a5a4c3 None admin] RBAC: Adding query filter params (role.id=8689bf0d70184aef9148c6b4a9758b32, scope.project.id=680354d08b5e4597b80901494f3d923c, user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:09.700626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f2273-a7f6-4bba-91e9-bde7a1a5a4c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.702097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f2273-a7f6-4bba-91e9-bde7a1a5a4c3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.708594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 49/93] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/role_assignments?user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.709824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f2273-a7f6-4bba-91e9-bde7a1a5a4c3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.733677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8a16b-6295-48ad-92b0-8c72758432cc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.777843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062254b-60f7-46d3-a65a-ed4ef602664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.778474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062254b-60f7-46d3-a65a-ed4ef602664a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.778764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062254b-60f7-46d3-a65a-ed4ef602664a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.779063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062254b-60f7-46d3-a65a-ed4ef602664a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.780420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062254b-60f7-46d3-a65a-ed4ef602664a None admin] RBAC: Adding query filter params (role.id=0abc70600d6f4948a59e9a14d33aa289, scope.project.id=680354d08b5e4597b80901494f3d923c, user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:09.780739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062254b-60f7-46d3-a65a-ed4ef602664a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.782474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062254b-60f7-46d3-a65a-ed4ef602664a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.797727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 45/94] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/role_assignments?user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=0abc70600d6f4948a59e9a14d33aa289 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.865113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f2273-a7f6-4bba-91e9-bde7a1a5a4c3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.908499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba622b-24d7-45bd-8c0c-43cae8a0ae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.909067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba622b-24d7-45bd-8c0c-43cae8a0ae89 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.909355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba622b-24d7-45bd-8c0c-43cae8a0ae89 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.909638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba622b-24d7-45bd-8c0c-43cae8a0ae89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.976042 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.995540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba622b-24d7-45bd-8c0c-43cae8a0ae89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.997120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba622b-24d7-45bd-8c0c-43cae8a0ae89 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:10.125260 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 50/95] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:10.130830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062254b-60f7-46d3-a65a-ed4ef602664a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:10.164362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:10.299497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062254b-60f7-46d3-a65a-ed4ef602664a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:10.363676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c590a-d607-45c7-826c-1ae6d5044022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:10.364437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c590a-d607-45c7-826c-1ae6d5044022 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.364753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c590a-d607-45c7-826c-1ae6d5044022 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.365030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c590a-d607-45c7-826c-1ae6d5044022 None admin] PATH_INFO: `/v3/projects/0bdc059dad8341619cce1bdf5e1c77df` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.366239 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c590a-d607-45c7-826c-1ae6d5044022 None admin] RBAC: Authorizing `identity:get_project(project_id=0bdc059dad8341619cce1bdf5e1c77df)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:10.367748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c590a-d607-45c7-826c-1ae6d5044022 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:10.369715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 46/96] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:10 2022] GET /identity/v3/projects/0bdc059dad8341619cce1bdf5e1c77df => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:10.376146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba622b-24d7-45bd-8c0c-43cae8a0ae89 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:10.512355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:10.535310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba622b-24d7-45bd-8c0c-43cae8a0ae89 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:10.581068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69caef1-88a9-463f-8eb6-7329e2945505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:10.581701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69caef1-88a9-463f-8eb6-7329e2945505 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.581994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69caef1-88a9-463f-8eb6-7329e2945505 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.582314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69caef1-88a9-463f-8eb6-7329e2945505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.583111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69caef1-88a9-463f-8eb6-7329e2945505 None admin] RBAC: Adding query filter params (role.id=8689bf0d70184aef9148c6b4a9758b32, scope.project.id=0bdc059dad8341619cce1bdf5e1c77df, user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:10.583434 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69caef1-88a9-463f-8eb6-7329e2945505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:10.584913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69caef1-88a9-463f-8eb6-7329e2945505 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:10.593759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 51/97] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:10 2022] GET /identity/v3/role_assignments?user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec&scope.project.id=0bdc059dad8341619cce1bdf5e1c77df&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:11.770330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad0c1-0bed-485c-a8fd-007cfab6706d None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.770878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad0c1-0bed-485c-a8fd-007cfab6706d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.770954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad0c1-0bed-485c-a8fd-007cfab6706d None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.772476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 47/98] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:11.777839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b761a8-78ca-4bdb-a057-a5c19f6584a9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.778240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b761a8-78ca-4bdb-a057-a5c19f6584a9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.778574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b761a8-78ca-4bdb-a057-a5c19f6584a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.803526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-89b761a8-78ca-4bdb-a057-a5c19f6584a9 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:11.804734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-89b761a8-78ca-4bdb-a057-a5c19f6584a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:11.899201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 52/99] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:12.054384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99b037-e76a-499b-945c-be46a472da84 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.054681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99b037-e76a-499b-945c-be46a472da84 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.054871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99b037-e76a-499b-945c-be46a472da84 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.056413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 48/100] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:12.062187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5fcb1-0b71-47d2-8243-3345a0e2e587 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.062522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5fcb1-0b71-47d2-8243-3345a0e2e587 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.062811 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5fcb1-0b71-47d2-8243-3345a0e2e587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.084222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7bb5fcb1-0b71-47d2-8243-3345a0e2e587 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:12.085437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7bb5fcb1-0b71-47d2-8243-3345a0e2e587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:12.180013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 53/101] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:12.376706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99b037-e76a-499b-945c-be46a472da84 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:12.480421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:12.505751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99b037-e76a-499b-945c-be46a472da84 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:12.555757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45957c-a131-4edb-8f49-1f81484acd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:12.556404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45957c-a131-4edb-8f49-1f81484acd84 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.556690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45957c-a131-4edb-8f49-1f81484acd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.556971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45957c-a131-4edb-8f49-1f81484acd84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.570644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45957c-a131-4edb-8f49-1f81484acd84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-1d45957c-a131-4edb-8f49-1f81484acd84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:12.575451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:12.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:12.579015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 49/102] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:12.583312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5fcb1-0b71-47d2-8243-3345a0e2e587 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:12.604484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:12.744871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5fcb1-0b71-47d2-8243-3345a0e2e587 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:12.783756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45957c-a131-4edb-8f49-1f81484acd84 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:12.803636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721fdad-dee6-4318-8490-c7505a6975c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:12.804315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721fdad-dee6-4318-8490-c7505a6975c5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.804608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721fdad-dee6-4318-8490-c7505a6975c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.804885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721fdad-dee6-4318-8490-c7505a6975c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.805578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721fdad-dee6-4318-8490-c7505a6975c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:12.805883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721fdad-dee6-4318-8490-c7505a6975c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:12.808162 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721fdad-dee6-4318-8490-c7505a6975c5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:12.824280 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 54/103] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:12.825777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c6852-b307-412f-bf33-c700a22244dd None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.826357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c6852-b307-412f-bf33-c700a22244dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.826806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c6852-b307-412f-bf33-c700a22244dd None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.828212 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 55/104] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:12.829416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780938ec-b01d-495c-ba0f-4c445ae712dd None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.829917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780938ec-b01d-495c-ba0f-4c445ae712dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.830382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780938ec-b01d-495c-ba0f-4c445ae712dd None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.832054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 56/105] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:12.833259 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ea17-8c96-401d-a5c4-966dc3bfe958 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.833734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ea17-8c96-401d-a5c4-966dc3bfe958 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.834216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ea17-8c96-401d-a5c4-966dc3bfe958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.854141 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9189ea17-8c96-401d-a5c4-966dc3bfe958 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:12.855746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9189ea17-8c96-401d-a5c4-966dc3bfe958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:12.929197 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45957c-a131-4edb-8f49-1f81484acd84 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:12.932686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:12.938395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 57/106] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:12.939493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ea17-8c96-401d-a5c4-966dc3bfe958 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:13.017720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8aad7a-0658-4041-bcd1-4011cd0f53da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:13.018642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aad7a-0658-4041-bcd1-4011cd0f53da None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.019130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aad7a-0658-4041-bcd1-4011cd0f53da None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.019576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aad7a-0658-4041-bcd1-4011cd0f53da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.045992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8aad7a-0658-4041-bcd1-4011cd0f53da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-4e8aad7a-0658-4041-bcd1-4011cd0f53da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:13.051948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:13.052839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:13.053597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:13.055622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 50/107] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:13.064848 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5620b1-4263-43c3-a68e-b1092216959e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.066440 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5620b1-4263-43c3-a68e-b1092216959e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.066723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5620b1-4263-43c3-a68e-b1092216959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.093208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-cc5620b1-4263-43c3-a68e-b1092216959e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:13.095335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cc5620b1-4263-43c3-a68e-b1092216959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:13.114762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:13.143985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ea17-8c96-401d-a5c4-966dc3bfe958 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:13.180285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 51/108] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:13.181080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5620b1-4263-43c3-a68e-b1092216959e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:13.187373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc1ed9-4218-45c1-9d50-1329caddc435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:13.188154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc1ed9-4218-45c1-9d50-1329caddc435 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.188540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc1ed9-4218-45c1-9d50-1329caddc435 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.188921 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc1ed9-4218-45c1-9d50-1329caddc435 None admin] PATH_INFO: `/v3/users/360b6abf2f0e4fd18bda140d1e9c6378` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.190283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc1ed9-4218-45c1-9d50-1329caddc435 None admin] RBAC: Authorizing `identity:get_user(user_id=360b6abf2f0e4fd18bda140d1e9c6378)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:13.192023 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc1ed9-4218-45c1-9d50-1329caddc435 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:13.193864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 58/109] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:12 2022] GET /identity/v3/users/360b6abf2f0e4fd18bda140d1e9c6378 => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:13.195233 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecee99-f254-4be5-aca0-9e2de98c78a7 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.195478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecee99-f254-4be5-aca0-9e2de98c78a7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.195823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecee99-f254-4be5-aca0-9e2de98c78a7 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.197479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 59/110] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:13.203830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecee99-f254-4be5-aca0-9e2de98c78a7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:13.298367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:13.315132 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5620b1-4263-43c3-a68e-b1092216959e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:13.346612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:13.349756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecee99-f254-4be5-aca0-9e2de98c78a7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:13.351797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828a2b2-3005-4ab2-9aec-8529cccf4461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:13.352531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828a2b2-3005-4ab2-9aec-8529cccf4461 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.352885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828a2b2-3005-4ab2-9aec-8529cccf4461 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.353233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828a2b2-3005-4ab2-9aec-8529cccf4461 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.354038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828a2b2-3005-4ab2-9aec-8529cccf4461 None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:13.354413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828a2b2-3005-4ab2-9aec-8529cccf4461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:13.355944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828a2b2-3005-4ab2-9aec-8529cccf4461 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:13.365670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 52/111] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:13.366803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52413-56a2-44e4-9c25-574f4ea36056 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.367213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52413-56a2-44e4-9c25-574f4ea36056 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.367566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52413-56a2-44e4-9c25-574f4ea36056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.387378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-92c52413-56a2-44e4-9c25-574f4ea36056 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:13.388732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-92c52413-56a2-44e4-9c25-574f4ea36056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:13.407285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf448e-89e4-4100-9065-b1073984912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:13.408328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf448e-89e4-4100-9065-b1073984912b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.408819 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf448e-89e4-4100-9065-b1073984912b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.409498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf448e-89e4-4100-9065-b1073984912b None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.411495 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf448e-89e4-4100-9065-b1073984912b None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:13.413164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf448e-89e4-4100-9065-b1073984912b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:13.416100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 60/112] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:13 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:13.417323 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf448e-89e4-4100-9065-b1073984912b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:13.489465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 53/113] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:13.490979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c52413-56a2-44e4-9c25-574f4ea36056 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:13.566114 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf448e-89e4-4100-9065-b1073984912b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:13.608327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c79f-edf0-456d-a3e2-434896c2737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:13.609331 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c79f-edf0-456d-a3e2-434896c2737e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.609705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c79f-edf0-456d-a3e2-434896c2737e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.610048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c79f-edf0-456d-a3e2-434896c2737e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.613380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:13.623638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c52413-56a2-44e4-9c25-574f4ea36056 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:13.627863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426c79f-edf0-456d-a3e2-434896c2737e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0426c79f-edf0-456d-a3e2-434896c2737e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:13.632875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:13.633717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:13.635518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 61/114] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:13.639950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c79f-edf0-456d-a3e2-434896c2737e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:13.650003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:13.661608 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc7dff-c424-4862-a197-c77653eaadb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:13.662578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc7dff-c424-4862-a197-c77653eaadb8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.662871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc7dff-c424-4862-a197-c77653eaadb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.663342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc7dff-c424-4862-a197-c77653eaadb8 None admin] PATH_INFO: `/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.664491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc7dff-c424-4862-a197-c77653eaadb8 None admin] RBAC: Authorizing `identity:get_user(user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:13.666011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc7dff-c424-4862-a197-c77653eaadb8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:13.667674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 54/115] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:13 2022] GET /identity/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:13.668442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc7dff-c424-4862-a197-c77653eaadb8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:13.774293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c79f-edf0-456d-a3e2-434896c2737e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:13.797460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc7dff-c424-4862-a197-c77653eaadb8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:13.815320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87fd8f-088a-43a0-9cd2-e93897d0571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:13.816007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87fd8f-088a-43a0-9cd2-e93897d0571d None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.816346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87fd8f-088a-43a0-9cd2-e93897d0571d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.816571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87fd8f-088a-43a0-9cd2-e93897d0571d None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c/users/360b6abf2f0e4fd18bda140d1e9c6378/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.818671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87fd8f-088a-43a0-9cd2-e93897d0571d None admin] RBAC: Authorizing `identity:create_grant(project_id=680354d08b5e4597b80901494f3d923c, user_id=360b6abf2f0e4fd18bda140d1e9c6378, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:13.820200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87fd8f-088a-43a0-9cd2-e93897d0571d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:13.839524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bda84-4a90-454f-88d7-403f44656c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:13.840178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bda84-4a90-454f-88d7-403f44656c0c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.840460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bda84-4a90-454f-88d7-403f44656c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.840738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bda84-4a90-454f-88d7-403f44656c0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.842439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bda84-4a90-454f-88d7-403f44656c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:13.843930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bda84-4a90-454f-88d7-403f44656c0c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:13.845536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 55/116] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:13.846675 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2e499-758f-4aa5-ae73-c11165cb0f96 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.846956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2e499-758f-4aa5-ae73-c11165cb0f96 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.847264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2e499-758f-4aa5-ae73-c11165cb0f96 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.848495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 56/117] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:13.849198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2e499-758f-4aa5-ae73-c11165cb0f96 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:13.894800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 62/118] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:13 2022] PUT /identity/v3/projects/680354d08b5e4597b80901494f3d923c/users/360b6abf2f0e4fd18bda140d1e9c6378/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:13.895685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87fd8f-088a-43a0-9cd2-e93897d0571d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:13.930850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:13.963077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:13.980677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2e499-758f-4aa5-ae73-c11165cb0f96 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.015543 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87fd8f-088a-43a0-9cd2-e93897d0571d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.023431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3a465-534c-4791-9453-166c37942af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.024057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3a465-534c-4791-9453-166c37942af6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.024351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3a465-534c-4791-9453-166c37942af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.024709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3a465-534c-4791-9453-166c37942af6 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.025909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3a465-534c-4791-9453-166c37942af6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:14.026223 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3a465-534c-4791-9453-166c37942af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.028075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3a465-534c-4791-9453-166c37942af6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.039568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 57/119] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:14.046157 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3a465-534c-4791-9453-166c37942af6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.063609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc268-1138-4603-9bb3-71845fb3650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.064260 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc268-1138-4603-9bb3-71845fb3650d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.064547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc268-1138-4603-9bb3-71845fb3650d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.064843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc268-1138-4603-9bb3-71845fb3650d None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.066060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fc268-1138-4603-9bb3-71845fb3650d None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.067639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fc268-1138-4603-9bb3-71845fb3650d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.069417 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 63/120] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:13 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:14.069997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc268-1138-4603-9bb3-71845fb3650d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.172635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3a465-534c-4791-9453-166c37942af6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.174232 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc268-1138-4603-9bb3-71845fb3650d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.198710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.201486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.212225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58f550-8944-4787-bbfd-070ae96c73de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.212928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58f550-8944-4787-bbfd-070ae96c73de None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.213217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58f550-8944-4787-bbfd-070ae96c73de None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.213501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58f550-8944-4787-bbfd-070ae96c73de None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.214161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58f550-8944-4787-bbfd-070ae96c73de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.215196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79cc3d-b9e9-4d7f-b05c-37ae669d0fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.215658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58f550-8944-4787-bbfd-070ae96c73de None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.216316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79cc3d-b9e9-4d7f-b05c-37ae669d0fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.216806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79cc3d-b9e9-4d7f-b05c-37ae669d0fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.217256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79cc3d-b9e9-4d7f-b05c-37ae669d0fb1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.229968 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79cc3d-b9e9-4d7f-b05c-37ae669d0fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-4a79cc3d-b9e9-4d7f-b05c-37ae669d0fb1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:14.236347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:14.239760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 58/121] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:14.241278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c854e6-24c9-4856-bd71-53ddc9904b85 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.243736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c854e6-24c9-4856-bd71-53ddc9904b85 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.243736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c854e6-24c9-4856-bd71-53ddc9904b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.258802 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-05c854e6-24c9-4856-bd71-53ddc9904b85 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:14.260072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-05c854e6-24c9-4856-bd71-53ddc9904b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:14.284458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 64/122] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:26:14 2022] POST /identity/v3/projects => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:14.285525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58f550-8944-4787-bbfd-070ae96c73de None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.364551 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 59/123] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:14.366091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c854e6-24c9-4856-bd71-53ddc9904b85 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.456702 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58f550-8944-4787-bbfd-070ae96c73de None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.511834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4a3c7-30dc-4dee-b361-dec839f80cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.512482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4a3c7-30dc-4dee-b361-dec839f80cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.512822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4a3c7-30dc-4dee-b361-dec839f80cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.513107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4a3c7-30dc-4dee-b361-dec839f80cb5 None admin] PATH_INFO: `/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.516023 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4a3c7-30dc-4dee-b361-dec839f80cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.517551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4a3c7-30dc-4dee-b361-dec839f80cb5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.519401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 65/124] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:14.520092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4a3c7-30dc-4dee-b361-dec839f80cb5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.554581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c854e6-24c9-4856-bd71-53ddc9904b85 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.581577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.607432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.623271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d60a78-8b49-4f01-beb8-b4635a749aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.623973 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d60a78-8b49-4f01-beb8-b4635a749aaf None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.624261 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d60a78-8b49-4f01-beb8-b4635a749aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.624535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d60a78-8b49-4f01-beb8-b4635a749aaf None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c/users/e4f302dc9d704ac4bcbb8f3332a3c0ec/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.627237 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d60a78-8b49-4f01-beb8-b4635a749aaf None admin] RBAC: Authorizing `identity:create_grant(project_id=680354d08b5e4597b80901494f3d923c, user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.628711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d60a78-8b49-4f01-beb8-b4635a749aaf None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.679812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4a3c7-30dc-4dee-b361-dec839f80cb5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.714558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c71736-8fa4-4abc-8f37-9368e5486bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.715534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c71736-8fa4-4abc-8f37-9368e5486bae None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.716479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c71736-8fa4-4abc-8f37-9368e5486bae None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.717473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c71736-8fa4-4abc-8f37-9368e5486bae None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.718489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c71736-8fa4-4abc-8f37-9368e5486bae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:14.719332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c71736-8fa4-4abc-8f37-9368e5486bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.721732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c71736-8fa4-4abc-8f37-9368e5486bae None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.725058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 60/125] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:14 2022] PUT /identity/v3/projects/680354d08b5e4597b80901494f3d923c/users/e4f302dc9d704ac4bcbb8f3332a3c0ec/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:14.734745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d60a78-8b49-4f01-beb8-b4635a749aaf None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.738429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 66/126] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:14.738429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c71736-8fa4-4abc-8f37-9368e5486bae None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.885822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d60a78-8b49-4f01-beb8-b4635a749aaf None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.933216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a427-74ca-4fc7-aac4-afaf6e6d4872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.933877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a427-74ca-4fc7-aac4-afaf6e6d4872 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.934168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a427-74ca-4fc7-aac4-afaf6e6d4872 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.934447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a427-74ca-4fc7-aac4-afaf6e6d4872 None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.936790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668a427-74ca-4fc7-aac4-afaf6e6d4872 None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.937733 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668a427-74ca-4fc7-aac4-afaf6e6d4872 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.939656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 61/127] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:14.941030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a427-74ca-4fc7-aac4-afaf6e6d4872 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.988272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.019622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c71736-8fa4-4abc-8f37-9368e5486bae None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.035105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.051125 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a427-74ca-4fc7-aac4-afaf6e6d4872 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.085210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a167f-ff9a-4556-988c-f10cb5488b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.085876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a167f-ff9a-4556-988c-f10cb5488b40 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.086164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a167f-ff9a-4556-988c-f10cb5488b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.086444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a167f-ff9a-4556-988c-f10cb5488b40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.089899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97bc8c-dafd-4ccc-9cb9-004cae3e8748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.090546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97bc8c-dafd-4ccc-9cb9-004cae3e8748 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.090834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97bc8c-dafd-4ccc-9cb9-004cae3e8748 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.091146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97bc8c-dafd-4ccc-9cb9-004cae3e8748 None admin] PATH_INFO: `/v3/users/fef45bf8a1f745a5a52e9b4901b261cd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.106535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97bc8c-dafd-4ccc-9cb9-004cae3e8748 None admin] RBAC: Authorizing `identity:get_user(user_id=fef45bf8a1f745a5a52e9b4901b261cd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.108612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97bc8c-dafd-4ccc-9cb9-004cae3e8748 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.108742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a167f-ff9a-4556-988c-f10cb5488b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:15.110557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 62/128] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/users/fef45bf8a1f745a5a52e9b4901b261cd => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:15.111341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97bc8c-dafd-4ccc-9cb9-004cae3e8748 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0a2a167f-ff9a-4556-988c-f10cb5488b40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:15.114103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:15.115364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:15.116465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:15.123440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 67/129] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:15.124307 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a167f-ff9a-4556-988c-f10cb5488b40 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.219936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97bc8c-dafd-4ccc-9cb9-004cae3e8748 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.240698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.255220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d500cb-0977-4d10-945f-adf3a96ed5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.255899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d500cb-0977-4d10-945f-adf3a96ed5c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.256189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d500cb-0977-4d10-945f-adf3a96ed5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.257522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d500cb-0977-4d10-945f-adf3a96ed5c6 None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c/users/e4f302dc9d704ac4bcbb8f3332a3c0ec/roles/0abc70600d6f4948a59e9a14d33aa289` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.259120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d500cb-0977-4d10-945f-adf3a96ed5c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=680354d08b5e4597b80901494f3d923c, user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec, role_id=0abc70600d6f4948a59e9a14d33aa289)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.263068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d500cb-0977-4d10-945f-adf3a96ed5c6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.300701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a167f-ff9a-4556-988c-f10cb5488b40 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.344139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 63/130] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:15 2022] PUT /identity/v3/projects/680354d08b5e4597b80901494f3d923c/users/e4f302dc9d704ac4bcbb8f3332a3c0ec/roles/0abc70600d6f4948a59e9a14d33aa289 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:15.345045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d500cb-0977-4d10-945f-adf3a96ed5c6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.350003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086638e-aace-4f66-82b7-90d4d6d1b0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.350634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086638e-aace-4f66-82b7-90d4d6d1b0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.350914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086638e-aace-4f66-82b7-90d4d6d1b0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.352338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086638e-aace-4f66-82b7-90d4d6d1b0d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.424361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.501519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086638e-aace-4f66-82b7-90d4d6d1b0d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.503076 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086638e-aace-4f66-82b7-90d4d6d1b0d4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.569214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d500cb-0977-4d10-945f-adf3a96ed5c6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.630725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 68/131] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:15.636127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086638e-aace-4f66-82b7-90d4d6d1b0d4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.708715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39ad8b-754d-46c5-96d7-d7b4b142c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.709364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39ad8b-754d-46c5-96d7-d7b4b142c20c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.709471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.709633 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39ad8b-754d-46c5-96d7-d7b4b142c20c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.709915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39ad8b-754d-46c5-96d7-d7b4b142c20c None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.710610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39ad8b-754d-46c5-96d7-d7b4b142c20c None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:15.711077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39ad8b-754d-46c5-96d7-d7b4b142c20c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.712371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39ad8b-754d-46c5-96d7-d7b4b142c20c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.741201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 64/132] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:15.759147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39ad8b-754d-46c5-96d7-d7b4b142c20c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.786456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086638e-aace-4f66-82b7-90d4d6d1b0d4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.792232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.858340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3652-fdb7-41ef-9d27-f2a5eacd561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.858340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3652-fdb7-41ef-9d27-f2a5eacd561a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.858340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3652-fdb7-41ef-9d27-f2a5eacd561a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.858744 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3652-fdb7-41ef-9d27-f2a5eacd561a None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.861639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e3652-fdb7-41ef-9d27-f2a5eacd561a None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.863058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e3652-fdb7-41ef-9d27-f2a5eacd561a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.864794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 69/133] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:15.876501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3652-fdb7-41ef-9d27-f2a5eacd561a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.017150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39ad8b-754d-46c5-96d7-d7b4b142c20c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.020578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3652-fdb7-41ef-9d27-f2a5eacd561a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.075519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be712317-5f30-405d-b7f0-f05513fdff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.076685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be712317-5f30-405d-b7f0-f05513fdff06 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.076976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be712317-5f30-405d-b7f0-f05513fdff06 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.077255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be712317-5f30-405d-b7f0-f05513fdff06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.078022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be712317-5f30-405d-b7f0-f05513fdff06 None admin] RBAC: Adding query filter params (role.id=699bd71b35c444f6b0f64e4e2b14b682, scope.project.id=680354d08b5e4597b80901494f3d923c, user.id=fef45bf8a1f745a5a52e9b4901b261cd) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:16.078341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be712317-5f30-405d-b7f0-f05513fdff06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.079896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be712317-5f30-405d-b7f0-f05513fdff06 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.085172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.086849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 70/134] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/role_assignments?user.id=fef45bf8a1f745a5a52e9b4901b261cd&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=699bd71b35c444f6b0f64e4e2b14b682 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.129708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f302ad-405a-412d-9993-a31f0816678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.130362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f302ad-405a-412d-9993-a31f0816678a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.130639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f302ad-405a-412d-9993-a31f0816678a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.130972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f302ad-405a-412d-9993-a31f0816678a None admin] PATH_INFO: `/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.134771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f302ad-405a-412d-9993-a31f0816678a None admin] RBAC: Authorizing `identity:get_user(user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.136363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f302ad-405a-412d-9993-a31f0816678a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.138897 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 65/135] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec => generated 275 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.144611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be712317-5f30-405d-b7f0-f05513fdff06 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.283864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be712317-5f30-405d-b7f0-f05513fdff06 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.323389 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408e77-1fac-4ecc-bca4-99d040817f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.324047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408e77-1fac-4ecc-bca4-99d040817f65 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.324332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408e77-1fac-4ecc-bca4-99d040817f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.324615 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408e77-1fac-4ecc-bca4-99d040817f65 None admin] PATH_INFO: `/v3/projects/0bdc059dad8341619cce1bdf5e1c77df` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.326466 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408e77-1fac-4ecc-bca4-99d040817f65 None admin] RBAC: Authorizing `identity:get_project(project_id=0bdc059dad8341619cce1bdf5e1c77df)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.328089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408e77-1fac-4ecc-bca4-99d040817f65 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.329988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 71/136] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/projects/0bdc059dad8341619cce1bdf5e1c77df => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.336073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f302ad-405a-412d-9993-a31f0816678a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.442133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.459388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f302ad-405a-412d-9993-a31f0816678a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.509138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43085dc1-0e66-444b-be09-0d7d25b10d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.509831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085dc1-0e66-444b-be09-0d7d25b10d86 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.510117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085dc1-0e66-444b-be09-0d7d25b10d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.510396 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085dc1-0e66-444b-be09-0d7d25b10d86 None admin] PATH_INFO: `/v3/projects/0bdc059dad8341619cce1bdf5e1c77df/users/e4f302dc9d704ac4bcbb8f3332a3c0ec/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.512429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43085dc1-0e66-444b-be09-0d7d25b10d86 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bdc059dad8341619cce1bdf5e1c77df, user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.513948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43085dc1-0e66-444b-be09-0d7d25b10d86 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.535405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9ebd7-7455-4d15-997e-46024d026876 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.535716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9ebd7-7455-4d15-997e-46024d026876 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.536000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9ebd7-7455-4d15-997e-46024d026876 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.537673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 72/137] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:16.542953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd8556-d5a3-4800-8dea-878f038fa025 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.543379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd8556-d5a3-4800-8dea-878f038fa025 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.543709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd8556-d5a3-4800-8dea-878f038fa025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.563575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c3dd8556-d5a3-4800-8dea-878f038fa025 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:16.565094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c3dd8556-d5a3-4800-8dea-878f038fa025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:16.609279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 66/138] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:16 2022] PUT /identity/v3/projects/0bdc059dad8341619cce1bdf5e1c77df/users/e4f302dc9d704ac4bcbb8f3332a3c0ec/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:16.641546 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.649640 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 73/139] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:17.024573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444c84-44c9-4720-ae56-df14ff02503b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.028956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444c84-44c9-4720-ae56-df14ff02503b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.028956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444c84-44c9-4720-ae56-df14ff02503b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.028956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 67/140] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:17.032841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31649b4f-e2f9-4b9f-aeb9-87878238334b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.033660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31649b4f-e2f9-4b9f-aeb9-87878238334b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.034135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31649b4f-e2f9-4b9f-aeb9-87878238334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.065550 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-31649b4f-e2f9-4b9f-aeb9-87878238334b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:17.067138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-31649b4f-e2f9-4b9f-aeb9-87878238334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:17.071809 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc0b8-42d2-4984-a15c-8e24cd10edc7 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.072352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc0b8-42d2-4984-a15c-8e24cd10edc7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.072829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc0b8-42d2-4984-a15c-8e24cd10edc7 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.074659 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 68/141] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:17.080233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe761ab-ccc4-4aa0-8975-a39e84426441 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.080767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe761ab-ccc4-4aa0-8975-a39e84426441 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.081256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe761ab-ccc4-4aa0-8975-a39e84426441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.112431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-afe761ab-ccc4-4aa0-8975-a39e84426441 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:17.115615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-afe761ab-ccc4-4aa0-8975-a39e84426441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:17.230579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 74/142] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:17.235922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31649b4f-e2f9-4b9f-aeb9-87878238334b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.266233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 69/143] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:17.383791 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31649b4f-e2f9-4b9f-aeb9-87878238334b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.437634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.452545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53693b9f-8b68-4015-83e9-40f8aaecdd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.453188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53693b9f-8b68-4015-83e9-40f8aaecdd82 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.453470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53693b9f-8b68-4015-83e9-40f8aaecdd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.453749 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53693b9f-8b68-4015-83e9-40f8aaecdd82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.472684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53693b9f-8b68-4015-83e9-40f8aaecdd82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-53693b9f-8b68-4015-83e9-40f8aaecdd82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:17.481000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:17.481937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:17.482750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 75/144] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:17.490246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe761ab-ccc4-4aa0-8975-a39e84426441 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.540068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53693b9f-8b68-4015-83e9-40f8aaecdd82 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.595449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.635578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe761ab-ccc4-4aa0-8975-a39e84426441 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.684474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274473d-b156-480f-95ec-4500b3c150e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.685271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274473d-b156-480f-95ec-4500b3c150e9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.685560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274473d-b156-480f-95ec-4500b3c150e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.685837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274473d-b156-480f-95ec-4500b3c150e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.686530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274473d-b156-480f-95ec-4500b3c150e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:17.686841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274473d-b156-480f-95ec-4500b3c150e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.688285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274473d-b156-480f-95ec-4500b3c150e9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.705140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 70/145] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.705948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274473d-b156-480f-95ec-4500b3c150e9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.715836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53693b9f-8b68-4015-83e9-40f8aaecdd82 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.752186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a2227-5695-402e-9061-125655296e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.752810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2227-5695-402e-9061-125655296e26 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.753098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2227-5695-402e-9061-125655296e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.753372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2227-5695-402e-9061-125655296e26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.754524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a2227-5695-402e-9061-125655296e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.758070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a2227-5695-402e-9061-125655296e26 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.758211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 76/146] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.758916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a2227-5695-402e-9061-125655296e26 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.847073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.869424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a2227-5695-402e-9061-125655296e26 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.931885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274473d-b156-480f-95ec-4500b3c150e9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.936661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36648554-2995-4d99-9b5f-aa21d47bf8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.937315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648554-2995-4d99-9b5f-aa21d47bf8bd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.937602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648554-2995-4d99-9b5f-aa21d47bf8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.937880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648554-2995-4d99-9b5f-aa21d47bf8bd None admin] PATH_INFO: `/v3/users/360b6abf2f0e4fd18bda140d1e9c6378` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.940092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36648554-2995-4d99-9b5f-aa21d47bf8bd None admin] RBAC: Authorizing `identity:get_user(user_id=360b6abf2f0e4fd18bda140d1e9c6378)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.941570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36648554-2995-4d99-9b5f-aa21d47bf8bd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.943361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 77/147] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/users/360b6abf2f0e4fd18bda140d1e9c6378 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.943946 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36648554-2995-4d99-9b5f-aa21d47bf8bd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.971031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196f2bf-7cd4-4e91-9016-9e3da67b97d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.971721 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196f2bf-7cd4-4e91-9016-9e3da67b97d7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.972006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196f2bf-7cd4-4e91-9016-9e3da67b97d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.972281 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196f2bf-7cd4-4e91-9016-9e3da67b97d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.982940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196f2bf-7cd4-4e91-9016-9e3da67b97d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-2196f2bf-7cd4-4e91-9016-9e3da67b97d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:17.988795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:17.989677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:17.990522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 71/148] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:17.991200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196f2bf-7cd4-4e91-9016-9e3da67b97d7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.995418 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.100325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196f2bf-7cd4-4e91-9016-9e3da67b97d7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.138930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fa45d-647b-488c-9b07-dad6bc07b189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.140205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fa45d-647b-488c-9b07-dad6bc07b189 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.140728 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fa45d-647b-488c-9b07-dad6bc07b189 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.141154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fa45d-647b-488c-9b07-dad6bc07b189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.160104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36648554-2995-4d99-9b5f-aa21d47bf8bd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.184463 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.223844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.227992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fa45d-647b-488c-9b07-dad6bc07b189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.229646 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fa45d-647b-488c-9b07-dad6bc07b189 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.230431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f449e9-876e-4286-88fd-b72200028508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.231278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f449e9-876e-4286-88fd-b72200028508 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.233719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f449e9-876e-4286-88fd-b72200028508 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.234417 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f449e9-876e-4286-88fd-b72200028508 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.235302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f449e9-876e-4286-88fd-b72200028508 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.238798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f449e9-876e-4286-88fd-b72200028508 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.342734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 78/149] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:17 2022] POST /identity/v3/users => generated 283 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:18.343624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f449e9-876e-4286-88fd-b72200028508 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.395787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 72/150] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:18.397076 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03feda-5a45-40db-a21d-9018c308a524 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.397367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03feda-5a45-40db-a21d-9018c308a524 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.397651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03feda-5a45-40db-a21d-9018c308a524 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.399023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 73/151] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:18.408115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03feda-5a45-40db-a21d-9018c308a524 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.550792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f449e9-876e-4286-88fd-b72200028508 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.594012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd786d-bce1-40a8-87fa-ca8dc1d89fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.594242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.594988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd786d-bce1-40a8-87fa-ca8dc1d89fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.595463 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd786d-bce1-40a8-87fa-ca8dc1d89fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.595875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd786d-bce1-40a8-87fa-ca8dc1d89fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.596696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd786d-bce1-40a8-87fa-ca8dc1d89fb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:18.597155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd786d-bce1-40a8-87fa-ca8dc1d89fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.598750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd786d-bce1-40a8-87fa-ca8dc1d89fb9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.599105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03feda-5a45-40db-a21d-9018c308a524 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.610608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 79/152] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:18.613164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53aa1e-c79e-4d1c-b1b5-5cf63d3a1b96 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.613684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53aa1e-c79e-4d1c-b1b5-5cf63d3a1b96 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.614152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53aa1e-c79e-4d1c-b1b5-5cf63d3a1b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.633343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0c53aa1e-c79e-4d1c-b1b5-5cf63d3a1b96 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:18.634869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0c53aa1e-c79e-4d1c-b1b5-5cf63d3a1b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:18.645743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23dd07-305b-4798-8333-dfb99f65c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.648382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23dd07-305b-4798-8333-dfb99f65c6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.648614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23dd07-305b-4798-8333-dfb99f65c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.648947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23dd07-305b-4798-8333-dfb99f65c6b0 None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.650558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23dd07-305b-4798-8333-dfb99f65c6b0 None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.652387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23dd07-305b-4798-8333-dfb99f65c6b0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.655829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 74/153] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:18.657030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23dd07-305b-4798-8333-dfb99f65c6b0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.677657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.720970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 80/154] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:18.722180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53aa1e-c79e-4d1c-b1b5-5cf63d3a1b96 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.803592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23dd07-305b-4798-8333-dfb99f65c6b0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.841686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0f482-37aa-4ced-9192-a45c523c5b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.842681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0f482-37aa-4ced-9192-a45c523c5b1c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.843350 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0f482-37aa-4ced-9192-a45c523c5b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.843911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0f482-37aa-4ced-9192-a45c523c5b1c None admin] PATH_INFO: `/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.845308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0f482-37aa-4ced-9192-a45c523c5b1c None admin] RBAC: Authorizing `identity:get_user(user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.846981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0f482-37aa-4ced-9192-a45c523c5b1c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.848947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 75/155] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:18.850392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf1e1-1c59-4597-bb31-91141ba18191 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.850818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf1e1-1c59-4597-bb31-91141ba18191 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.851254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf1e1-1c59-4597-bb31-91141ba18191 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.852760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 76/156] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:18.854411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaf1e1-1c59-4597-bb31-91141ba18191 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.856151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53aa1e-c79e-4d1c-b1b5-5cf63d3a1b96 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.900209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.906972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c14a14-012b-47bb-9e43-06f5a5e957b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.908054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c14a14-012b-47bb-9e43-06f5a5e957b3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.908532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c14a14-012b-47bb-9e43-06f5a5e957b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.909351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c14a14-012b-47bb-9e43-06f5a5e957b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.910583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c14a14-012b-47bb-9e43-06f5a5e957b3 None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=680354d08b5e4597b80901494f3d923c, user.id=360b6abf2f0e4fd18bda140d1e9c6378) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:18.911083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c14a14-012b-47bb-9e43-06f5a5e957b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.917385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c14a14-012b-47bb-9e43-06f5a5e957b3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.921099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 81/157] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/role_assignments?user.id=360b6abf2f0e4fd18bda140d1e9c6378&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:18.922715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee79f-ff3b-4276-b33b-ac9f015afc94 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.923217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee79f-ff3b-4276-b33b-ac9f015afc94 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.924169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee79f-ff3b-4276-b33b-ac9f015afc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.949652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-885ee79f-ff3b-4276-b33b-ac9f015afc94 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:18.951247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-885ee79f-ff3b-4276-b33b-ac9f015afc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:18.986067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaf1e1-1c59-4597-bb31-91141ba18191 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.992601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.032738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac550a-a07e-4f23-baa1-8fe8bedb61b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.033365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac550a-a07e-4f23-baa1-8fe8bedb61b2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.034835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac550a-a07e-4f23-baa1-8fe8bedb61b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.035151 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac550a-a07e-4f23-baa1-8fe8bedb61b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.060869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 82/158] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:19.123608 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac550a-a07e-4f23-baa1-8fe8bedb61b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.125126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac550a-a07e-4f23-baa1-8fe8bedb61b2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.170833 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.211244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee79f-ff3b-4276-b33b-ac9f015afc94 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.272314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 77/159] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:19.279082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac550a-a07e-4f23-baa1-8fe8bedb61b2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.405634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee79f-ff3b-4276-b33b-ac9f015afc94 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.456823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01073a17-61da-4b02-ad2a-42999bef069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.457488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01073a17-61da-4b02-ad2a-42999bef069c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.457775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01073a17-61da-4b02-ad2a-42999bef069c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.458055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01073a17-61da-4b02-ad2a-42999bef069c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.461221 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac550a-a07e-4f23-baa1-8fe8bedb61b2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.471863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01073a17-61da-4b02-ad2a-42999bef069c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-01073a17-61da-4b02-ad2a-42999bef069c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:19.478062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:19.478917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:19.479771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 83/160] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:19.482089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef073d-d8cf-483d-ba84-dabf4043c7cb None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.482833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef073d-d8cf-483d-ba84-dabf4043c7cb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.483297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef073d-d8cf-483d-ba84-dabf4043c7cb None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.485502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 84/161] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:19.486778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef073d-d8cf-483d-ba84-dabf4043c7cb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.510320 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afdc27-1e2c-488c-8f2f-05337c03f0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.510960 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afdc27-1e2c-488c-8f2f-05337c03f0db None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.511277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afdc27-1e2c-488c-8f2f-05337c03f0db None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.511553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afdc27-1e2c-488c-8f2f-05337c03f0db None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.513903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afdc27-1e2c-488c-8f2f-05337c03f0db None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.515619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.516623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afdc27-1e2c-488c-8f2f-05337c03f0db None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.518294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 78/162] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:19.519079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afdc27-1e2c-488c-8f2f-05337c03f0db None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.531210 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.614234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef073d-d8cf-483d-ba84-dabf4043c7cb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.655768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afdc27-1e2c-488c-8f2f-05337c03f0db None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.665674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938131b-2ec4-4b30-b534-c914bfcbfe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.666333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938131b-2ec4-4b30-b534-c914bfcbfe52 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.666613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938131b-2ec4-4b30-b534-c914bfcbfe52 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.666888 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938131b-2ec4-4b30-b534-c914bfcbfe52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.681258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938131b-2ec4-4b30-b534-c914bfcbfe52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f938131b-2ec4-4b30-b534-c914bfcbfe52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:19.688346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:19.689216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:19.689984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 85/163] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:19.691129 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bdc47-4430-4bfd-998b-e55b6b3b345d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.691129 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bdc47-4430-4bfd-998b-e55b6b3b345d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.691281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bdc47-4430-4bfd-998b-e55b6b3b345d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.701963 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c3138-78af-482d-9d6f-9887dec96712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.702838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c3138-78af-482d-9d6f-9887dec96712 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.703369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c3138-78af-482d-9d6f-9887dec96712 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.703854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c3138-78af-482d-9d6f-9887dec96712 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.704672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c3138-78af-482d-9d6f-9887dec96712 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:19.705113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c3138-78af-482d-9d6f-9887dec96712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.706646 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c3138-78af-482d-9d6f-9887dec96712 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.715769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-677bdc47-4430-4bfd-998b-e55b6b3b345d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:19.715932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 79/164] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:19.717481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-677bdc47-4430-4bfd-998b-e55b6b3b345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:19.717667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c3138-78af-482d-9d6f-9887dec96712 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.806504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 86/165] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:19.807432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bdc47-4430-4bfd-998b-e55b6b3b345d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.835731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.839222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.947739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c3138-78af-482d-9d6f-9887dec96712 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.964771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bdc47-4430-4bfd-998b-e55b6b3b345d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.022654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4966f-c9b7-4c78-8f92-a042a3b19524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.023229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4966f-c9b7-4c78-8f92-a042a3b19524 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.023531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4966f-c9b7-4c78-8f92-a042a3b19524 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.023785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4966f-c9b7-4c78-8f92-a042a3b19524 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.024456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4966f-c9b7-4c78-8f92-a042a3b19524 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:20.024762 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4966f-c9b7-4c78-8f92-a042a3b19524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.026238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4966f-c9b7-4c78-8f92-a042a3b19524 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.033871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea03099-7bef-4898-9a6d-e744ddc60915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.034507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea03099-7bef-4898-9a6d-e744ddc60915 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.034790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea03099-7bef-4898-9a6d-e744ddc60915 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.035115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea03099-7bef-4898-9a6d-e744ddc60915 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.035902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea03099-7bef-4898-9a6d-e744ddc60915 None admin] RBAC: Adding query filter params (role.id=8689bf0d70184aef9148c6b4a9758b32, scope.project.id=680354d08b5e4597b80901494f3d923c, user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:20.036213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea03099-7bef-4898-9a6d-e744ddc60915 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.037688 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea03099-7bef-4898-9a6d-e744ddc60915 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.041471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 87/166] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:20.042463 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4966f-c9b7-4c78-8f92-a042a3b19524 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.057042 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 80/167] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/role_assignments?user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:20.057899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea03099-7bef-4898-9a6d-e744ddc60915 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.157943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.182387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4966f-c9b7-4c78-8f92-a042a3b19524 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.219428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670fdb-fe8a-41d7-acf2-d76c7aa6da41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.220850 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670fdb-fe8a-41d7-acf2-d76c7aa6da41 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.221359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670fdb-fe8a-41d7-acf2-d76c7aa6da41 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.221837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670fdb-fe8a-41d7-acf2-d76c7aa6da41 None admin] PATH_INFO: `/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.223258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29670fdb-fe8a-41d7-acf2-d76c7aa6da41 None admin] RBAC: Authorizing `identity:get_user(user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.225048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29670fdb-fe8a-41d7-acf2-d76c7aa6da41 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.227222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 88/168] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:20.232380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670fdb-fe8a-41d7-acf2-d76c7aa6da41 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.272264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea03099-7bef-4898-9a6d-e744ddc60915 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.313543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.329248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c3398-af77-4393-9e97-0b72c18264f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.329926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c3398-af77-4393-9e97-0b72c18264f9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.330177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c3398-af77-4393-9e97-0b72c18264f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.330455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c3398-af77-4393-9e97-0b72c18264f9 None admin] PATH_INFO: `/v3/users/fef45bf8a1f745a5a52e9b4901b261cd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.331710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c3398-af77-4393-9e97-0b72c18264f9 None admin] RBAC: Authorizing `identity:get_user(user_id=fef45bf8a1f745a5a52e9b4901b261cd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.333426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c3398-af77-4393-9e97-0b72c18264f9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.335154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 81/169] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/users/fef45bf8a1f745a5a52e9b4901b261cd => generated 289 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:20.335950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c3398-af77-4393-9e97-0b72c18264f9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.347778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670fdb-fe8a-41d7-acf2-d76c7aa6da41 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.390537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a49df0-8219-4e5f-9229-e1849e52ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.391576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49df0-8219-4e5f-9229-e1849e52ce54 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.392074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49df0-8219-4e5f-9229-e1849e52ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.392561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a49df0-8219-4e5f-9229-e1849e52ce54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.411155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.470746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a49df0-8219-4e5f-9229-e1849e52ce54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.472574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a49df0-8219-4e5f-9229-e1849e52ce54 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.499541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c3398-af77-4393-9e97-0b72c18264f9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.555779 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309a5e-c332-4122-b8e1-af815b655dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.556437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309a5e-c332-4122-b8e1-af815b655dee None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.556722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309a5e-c332-4122-b8e1-af815b655dee None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.556997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309a5e-c332-4122-b8e1-af815b655dee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.575099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af309a5e-c332-4122-b8e1-af815b655dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-af309a5e-c332-4122-b8e1-af815b655dee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:20.581536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:20.582962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:20.584002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:20.584639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 89/170] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:20.584717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 82/171] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:20.584783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a49df0-8219-4e5f-9229-e1849e52ce54 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.592031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309a5e-c332-4122-b8e1-af815b655dee None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.643087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.701435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a49df0-8219-4e5f-9229-e1849e52ce54 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.720902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.741114 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40f5dd-a3a4-4d35-b202-0ac33b9ed8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.742279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40f5dd-a3a4-4d35-b202-0ac33b9ed8dd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.742567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40f5dd-a3a4-4d35-b202-0ac33b9ed8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.742842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40f5dd-a3a4-4d35-b202-0ac33b9ed8dd None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.744072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40f5dd-a3a4-4d35-b202-0ac33b9ed8dd None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.745859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40f5dd-a3a4-4d35-b202-0ac33b9ed8dd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.748629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 90/172] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:20.749418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40f5dd-a3a4-4d35-b202-0ac33b9ed8dd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.811858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309a5e-c332-4122-b8e1-af815b655dee None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.855421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126a0b3-7168-420d-88e7-d02595e5c76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.856035 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126a0b3-7168-420d-88e7-d02595e5c76f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.856265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126a0b3-7168-420d-88e7-d02595e5c76f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.856540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126a0b3-7168-420d-88e7-d02595e5c76f None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.858983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126a0b3-7168-420d-88e7-d02595e5c76f None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.860493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126a0b3-7168-420d-88e7-d02595e5c76f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.862150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 83/173] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:20.862914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126a0b3-7168-420d-88e7-d02595e5c76f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.928915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40f5dd-a3a4-4d35-b202-0ac33b9ed8dd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.955449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.998226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c75d1-3ada-41df-b052-810179620212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.998846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c75d1-3ada-41df-b052-810179620212 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.999154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c75d1-3ada-41df-b052-810179620212 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.999435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c75d1-3ada-41df-b052-810179620212 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.000112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c75d1-3ada-41df-b052-810179620212 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:21.000417 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c75d1-3ada-41df-b052-810179620212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.001817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c75d1-3ada-41df-b052-810179620212 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.025639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 91/174] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:21.029272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c75d1-3ada-41df-b052-810179620212 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.039173 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126a0b3-7168-420d-88e7-d02595e5c76f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.068351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.092201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26929c-5455-4254-be4d-af7560ca4095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.093001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26929c-5455-4254-be4d-af7560ca4095 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.093288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26929c-5455-4254-be4d-af7560ca4095 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.093573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26929c-5455-4254-be4d-af7560ca4095 None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c/users/fef45bf8a1f745a5a52e9b4901b261cd/roles/699bd71b35c444f6b0f64e4e2b14b682` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.095670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26929c-5455-4254-be4d-af7560ca4095 None admin] RBAC: Authorizing `identity:create_grant(project_id=680354d08b5e4597b80901494f3d923c, user_id=fef45bf8a1f745a5a52e9b4901b261cd, role_id=699bd71b35c444f6b0f64e4e2b14b682)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.097154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26929c-5455-4254-be4d-af7560ca4095 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.154240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c75d1-3ada-41df-b052-810179620212 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.192169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c74d3a-b4a6-4c53-90b6-4ec50d71a0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.193255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c74d3a-b4a6-4c53-90b6-4ec50d71a0aa None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.193789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c74d3a-b4a6-4c53-90b6-4ec50d71a0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.194258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c74d3a-b4a6-4c53-90b6-4ec50d71a0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.195225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c74d3a-b4a6-4c53-90b6-4ec50d71a0aa None admin] RBAC: Adding query filter params (role.id=0abc70600d6f4948a59e9a14d33aa289, scope.project.id=680354d08b5e4597b80901494f3d923c, user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:21.195833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c74d3a-b4a6-4c53-90b6-4ec50d71a0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.197531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c74d3a-b4a6-4c53-90b6-4ec50d71a0aa None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.204353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 92/175] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/role_assignments?user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=0abc70600d6f4948a59e9a14d33aa289 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:21.205456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c74d3a-b4a6-4c53-90b6-4ec50d71a0aa None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.228954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 84/176] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:20 2022] PUT /identity/v3/projects/680354d08b5e4597b80901494f3d923c/users/fef45bf8a1f745a5a52e9b4901b261cd/roles/699bd71b35c444f6b0f64e4e2b14b682 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:21.270166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.343802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c74d3a-b4a6-4c53-90b6-4ec50d71a0aa None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.383812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8e26d-f5a1-4d01-8f66-7773047fc264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.384912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e26d-f5a1-4d01-8f66-7773047fc264 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.385518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e26d-f5a1-4d01-8f66-7773047fc264 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.386072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e26d-f5a1-4d01-8f66-7773047fc264 None admin] PATH_INFO: `/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.387581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8e26d-f5a1-4d01-8f66-7773047fc264 None admin] RBAC: Authorizing `identity:get_user(user_id=e4f302dc9d704ac4bcbb8f3332a3c0ec)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.389832 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8e26d-f5a1-4d01-8f66-7773047fc264 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.391845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 93/177] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/users/e4f302dc9d704ac4bcbb8f3332a3c0ec => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:21.397945 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26929c-5455-4254-be4d-af7560ca4095 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.559861 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26929c-5455-4254-be4d-af7560ca4095 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.597994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e0988-bbf4-4c49-a1c9-95292911195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.599003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0988-bbf4-4c49-a1c9-95292911195e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.599838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0988-bbf4-4c49-a1c9-95292911195e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.600562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0988-bbf4-4c49-a1c9-95292911195e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.660268 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.674514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e0988-bbf4-4c49-a1c9-95292911195e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.676045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e0988-bbf4-4c49-a1c9-95292911195e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.784700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 85/178] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:21.790556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8e26d-f5a1-4d01-8f66-7773047fc264 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.889615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1df67a-1708-4d03-aa67-311edf97896a None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.889957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1df67a-1708-4d03-aa67-311edf97896a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.890240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1df67a-1708-4d03-aa67-311edf97896a None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.891631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 86/179] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:21.897146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ec9e0-4d49-4cd6-9bec-5878b654cd1d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.897432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ec9e0-4d49-4cd6-9bec-5878b654cd1d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.897826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ec9e0-4d49-4cd6-9bec-5878b654cd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.911296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8e26d-f5a1-4d01-8f66-7773047fc264 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.918748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4c2ec9e0-4d49-4cd6-9bec-5878b654cd1d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:21.920162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4c2ec9e0-4d49-4cd6-9bec-5878b654cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:21.924894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.965565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a40e17-71aa-46ad-98cb-5a61b3abba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.967019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a40e17-71aa-46ad-98cb-5a61b3abba3a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.967558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a40e17-71aa-46ad-98cb-5a61b3abba3a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.968197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a40e17-71aa-46ad-98cb-5a61b3abba3a None admin] PATH_INFO: `/v3/projects/0bdc059dad8341619cce1bdf5e1c77df` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.970308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a40e17-71aa-46ad-98cb-5a61b3abba3a None admin] RBAC: Authorizing `identity:get_project(project_id=0bdc059dad8341619cce1bdf5e1c77df)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.973133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a40e17-71aa-46ad-98cb-5a61b3abba3a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.975785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 94/180] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/projects/0bdc059dad8341619cce1bdf5e1c77df => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:21.981724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c646-f346-4255-bbac-a5edfc240e6f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.982374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c646-f346-4255-bbac-a5edfc240e6f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.982873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c646-f346-4255-bbac-a5edfc240e6f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.984663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 95/181] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:21.985584 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c646-f346-4255-bbac-a5edfc240e6f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.010470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 87/182] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:22.019068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ea789-4a79-4e07-85ab-b813a5191282 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.019068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ea789-4a79-4e07-85ab-b813a5191282 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.019068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ea789-4a79-4e07-85ab-b813a5191282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.034258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-434ea789-4a79-4e07-85ab-b813a5191282 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:22.035830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-434ea789-4a79-4e07-85ab-b813a5191282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:22.049577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.115912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 88/183] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:22.178822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c646-f346-4255-bbac-a5edfc240e6f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.230126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b9cf5-5390-48a7-ac6a-18d0b3974bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.231109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b9cf5-5390-48a7-ac6a-18d0b3974bfe None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.232113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b9cf5-5390-48a7-ac6a-18d0b3974bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.232599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b9cf5-5390-48a7-ac6a-18d0b3974bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.233556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b9cf5-5390-48a7-ac6a-18d0b3974bfe None admin] RBAC: Adding query filter params (role.id=8689bf0d70184aef9148c6b4a9758b32, scope.project.id=0bdc059dad8341619cce1bdf5e1c77df, user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:22.234311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b9cf5-5390-48a7-ac6a-18d0b3974bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.235983 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b9cf5-5390-48a7-ac6a-18d0b3974bfe None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.250059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 96/184] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/role_assignments?user.id=e4f302dc9d704ac4bcbb8f3332a3c0ec&scope.project.id=0bdc059dad8341619cce1bdf5e1c77df&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:22.257724 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616bfe5-d063-4f07-b285-2d6884d75ae2 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.258040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616bfe5-d063-4f07-b285-2d6884d75ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.258280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616bfe5-d063-4f07-b285-2d6884d75ae2 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.259686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 89/185] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:22.266290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24041ab-a926-457b-8715-7870d632cf98 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.266936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24041ab-a926-457b-8715-7870d632cf98 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.267452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24041ab-a926-457b-8715-7870d632cf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.304215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d24041ab-a926-457b-8715-7870d632cf98 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:22.306225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d24041ab-a926-457b-8715-7870d632cf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:22.349404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.401498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 97/186] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:22.427628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616bfe5-d063-4f07-b285-2d6884d75ae2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.444937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24041ab-a926-457b-8715-7870d632cf98 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.561058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616bfe5-d063-4f07-b285-2d6884d75ae2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.585790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24041ab-a926-457b-8715-7870d632cf98 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.597724 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16727f-d917-4d17-ba22-2dee80434c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.598447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16727f-d917-4d17-ba22-2dee80434c2d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.598726 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16727f-d917-4d17-ba22-2dee80434c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.598998 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16727f-d917-4d17-ba22-2dee80434c2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.611615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16727f-d917-4d17-ba22-2dee80434c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-cf16727f-d917-4d17-ba22-2dee80434c2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:22.617198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:22.618114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:22.619229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 90/187] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:22.624763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16727f-d917-4d17-ba22-2dee80434c2d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.627164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04d2ec-489e-44c2-bbda-e22868f9ccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.628007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04d2ec-489e-44c2-bbda-e22868f9ccf9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.628286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04d2ec-489e-44c2-bbda-e22868f9ccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.628556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04d2ec-489e-44c2-bbda-e22868f9ccf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.634949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.642249 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04d2ec-489e-44c2-bbda-e22868f9ccf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-3a04d2ec-489e-44c2-bbda-e22868f9ccf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:22.647769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:22.648847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:22.649842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 98/188] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:22.657396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04d2ec-489e-44c2-bbda-e22868f9ccf9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.704834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.747027 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16727f-d917-4d17-ba22-2dee80434c2d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.783742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10648c43-5226-4325-922f-1a5f07fb1d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.784351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648c43-5226-4325-922f-1a5f07fb1d59 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.784631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648c43-5226-4325-922f-1a5f07fb1d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.784902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648c43-5226-4325-922f-1a5f07fb1d59 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.785576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10648c43-5226-4325-922f-1a5f07fb1d59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:22.785883 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10648c43-5226-4325-922f-1a5f07fb1d59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.787359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10648c43-5226-4325-922f-1a5f07fb1d59 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.795942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04d2ec-489e-44c2-bbda-e22868f9ccf9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.796311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 91/189] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:22.797123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10648c43-5226-4325-922f-1a5f07fb1d59 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.845863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2d299-f420-4be4-be0b-f22bba9a95b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.847685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d299-f420-4be4-be0b-f22bba9a95b7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.847685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d299-f420-4be4-be0b-f22bba9a95b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.847914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d299-f420-4be4-be0b-f22bba9a95b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.848554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2d299-f420-4be4-be0b-f22bba9a95b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:22.848855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2d299-f420-4be4-be0b-f22bba9a95b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.851101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2d299-f420-4be4-be0b-f22bba9a95b7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.860184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 99/190] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:22.860825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2d299-f420-4be4-be0b-f22bba9a95b7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.898922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.932326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10648c43-5226-4325-922f-1a5f07fb1d59 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.960181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.970312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2d299-f420-4be4-be0b-f22bba9a95b7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.970952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56256efe-bc58-4345-bd75-53f11c38a932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.971611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56256efe-bc58-4345-bd75-53f11c38a932 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.971930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56256efe-bc58-4345-bd75-53f11c38a932 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.977062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56256efe-bc58-4345-bd75-53f11c38a932 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.977062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56256efe-bc58-4345-bd75-53f11c38a932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.977062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56256efe-bc58-4345-bd75-53f11c38a932 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.977289 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 92/191] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:22.978138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56256efe-bc58-4345-bd75-53f11c38a932 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.009922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be5457-0b0f-4dd4-9872-bd1c85167fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.011009 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5457-0b0f-4dd4-9872-bd1c85167fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.011522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5457-0b0f-4dd4-9872-bd1c85167fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.011936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5457-0b0f-4dd4-9872-bd1c85167fc9 None admin] PATH_INFO: `/v3/users/fd0bdd33ada34a5aa674a2501e56215f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.028064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be5457-0b0f-4dd4-9872-bd1c85167fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=fd0bdd33ada34a5aa674a2501e56215f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.029614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be5457-0b0f-4dd4-9872-bd1c85167fc9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.031600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 100/192] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/users/fd0bdd33ada34a5aa674a2501e56215f => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:23.032160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be5457-0b0f-4dd4-9872-bd1c85167fc9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.084088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56256efe-bc58-4345-bd75-53f11c38a932 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.120864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accb94c-2442-40e1-be1d-9efca5e17fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.121517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb94c-2442-40e1-be1d-9efca5e17fee None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.121797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb94c-2442-40e1-be1d-9efca5e17fee None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.122097 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accb94c-2442-40e1-be1d-9efca5e17fee None admin] PATH_INFO: `/v3/users/fd0bdd33ada34a5aa674a2501e56215f` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.124211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accb94c-2442-40e1-be1d-9efca5e17fee None admin] RBAC: Authorizing `identity:get_user(user_id=fd0bdd33ada34a5aa674a2501e56215f)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.125719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accb94c-2442-40e1-be1d-9efca5e17fee None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.127612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 93/193] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/users/fd0bdd33ada34a5aa674a2501e56215f => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:23.128233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accb94c-2442-40e1-be1d-9efca5e17fee None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.133452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.164509 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be5457-0b0f-4dd4-9872-bd1c85167fc9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.205791 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494a39d-a7e7-47e8-a2ca-8792aa630a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.206415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494a39d-a7e7-47e8-a2ca-8792aa630a3f None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.206688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494a39d-a7e7-47e8-a2ca-8792aa630a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.206961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494a39d-a7e7-47e8-a2ca-8792aa630a3f None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.207779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494a39d-a7e7-47e8-a2ca-8792aa630a3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.209240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494a39d-a7e7-47e8-a2ca-8792aa630a3f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.242676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accb94c-2442-40e1-be1d-9efca5e17fee None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.276818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e4558-1be4-4c35-b0f8-aa8cab4c39c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.277431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e4558-1be4-4c35-b0f8-aa8cab4c39c6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.277711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e4558-1be4-4c35-b0f8-aa8cab4c39c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.277986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e4558-1be4-4c35-b0f8-aa8cab4c39c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.333345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 101/194] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:23 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:23.334370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494a39d-a7e7-47e8-a2ca-8792aa630a3f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.338332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.359431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e4558-1be4-4c35-b0f8-aa8cab4c39c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.362158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e4558-1be4-4c35-b0f8-aa8cab4c39c6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.367989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.450789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494a39d-a7e7-47e8-a2ca-8792aa630a3f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.496449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05213193-07d2-4ed4-8df4-ec5b0c7c03da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.497573 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213193-07d2-4ed4-8df4-ec5b0c7c03da None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.497868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213193-07d2-4ed4-8df4-ec5b0c7c03da None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.498138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213193-07d2-4ed4-8df4-ec5b0c7c03da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.520617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 94/195] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:23.526140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e4558-1be4-4c35-b0f8-aa8cab4c39c6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.590243 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05213193-07d2-4ed4-8df4-ec5b0c7c03da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.592413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05213193-07d2-4ed4-8df4-ec5b0c7c03da None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.595260 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.664708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e4558-1be4-4c35-b0f8-aa8cab4c39c6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.668517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.710213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380f557-3aae-4ac9-b3f0-945be87a4c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.711358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380f557-3aae-4ac9-b3f0-945be87a4c01 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.711971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380f557-3aae-4ac9-b3f0-945be87a4c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.713033 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380f557-3aae-4ac9-b3f0-945be87a4c01 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.714869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380f557-3aae-4ac9-b3f0-945be87a4c01 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.717452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380f557-3aae-4ac9-b3f0-945be87a4c01 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.719577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 95/196] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:23.726516 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380f557-3aae-4ac9-b3f0-945be87a4c01 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.742594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 102/197] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:23.745219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3086ed-27ed-4c0b-b56d-ec3f0144253b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.745514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3086ed-27ed-4c0b-b56d-ec3f0144253b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.745793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3086ed-27ed-4c0b-b56d-ec3f0144253b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.748027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 103/198] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:23.749601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3086ed-27ed-4c0b-b56d-ec3f0144253b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.843278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380f557-3aae-4ac9-b3f0-945be87a4c01 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.895367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3086ed-27ed-4c0b-b56d-ec3f0144253b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.896669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534af1a2-2195-406d-a728-9acc27f5108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.898853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.899110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af1a2-2195-406d-a728-9acc27f5108c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.900023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af1a2-2195-406d-a728-9acc27f5108c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.900512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af1a2-2195-406d-a728-9acc27f5108c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.901463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534af1a2-2195-406d-a728-9acc27f5108c None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b, user.id=fd0bdd33ada34a5aa674a2501e56215f) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:23.901974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534af1a2-2195-406d-a728-9acc27f5108c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.904319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534af1a2-2195-406d-a728-9acc27f5108c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.913415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 96/199] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/role_assignments?user.id=fd0bdd33ada34a5aa674a2501e56215f&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:23.915139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77382c-6f8d-42dd-bd5e-151db430ace8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.915589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77382c-6f8d-42dd-bd5e-151db430ace8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.918222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77382c-6f8d-42dd-bd5e-151db430ace8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.937585 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9e77382c-6f8d-42dd-bd5e-151db430ace8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:23.939219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9e77382c-6f8d-42dd-bd5e-151db430ace8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:23.974100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a25aa5-17c4-47af-9dd4-88289f4b8397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.975037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a25aa5-17c4-47af-9dd4-88289f4b8397 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.975167 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a25aa5-17c4-47af-9dd4-88289f4b8397 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.975376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a25aa5-17c4-47af-9dd4-88289f4b8397 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.977870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.979862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a25aa5-17c4-47af-9dd4-88289f4b8397 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.981432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a25aa5-17c4-47af-9dd4-88289f4b8397 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.983351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 104/200] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:23.989933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a25aa5-17c4-47af-9dd4-88289f4b8397 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.027190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 97/201] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:24.154165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a25aa5-17c4-47af-9dd4-88289f4b8397 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.196834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c2448-1abe-4003-9c33-184751d24177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.197741 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c2448-1abe-4003-9c33-184751d24177 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.198198 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c2448-1abe-4003-9c33-184751d24177 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.198619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c2448-1abe-4003-9c33-184751d24177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.199535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c2448-1abe-4003-9c33-184751d24177 None admin] RBAC: Adding query filter params (role.id=0abc70600d6f4948a59e9a14d33aa289, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b, user.id=fd0bdd33ada34a5aa674a2501e56215f) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:24.199991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c2448-1abe-4003-9c33-184751d24177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:24.201662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c2448-1abe-4003-9c33-184751d24177 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:24.207399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 105/202] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/role_assignments?user.id=fd0bdd33ada34a5aa674a2501e56215f&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=0abc70600d6f4948a59e9a14d33aa289 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:24.334542 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77382c-6f8d-42dd-bd5e-151db430ace8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.463505 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77382c-6f8d-42dd-bd5e-151db430ace8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.516174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a29ddc-f38e-430b-84ce-7e1b882904ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.517084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a29ddc-f38e-430b-84ce-7e1b882904ad None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.517524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a29ddc-f38e-430b-84ce-7e1b882904ad None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.517943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a29ddc-f38e-430b-84ce-7e1b882904ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.536181 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a29ddc-f38e-430b-84ce-7e1b882904ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c0a29ddc-f38e-430b-84ce-7e1b882904ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:24.541635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:24.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:24.543750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:24.546738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 98/203] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:24.552176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c2448-1abe-4003-9c33-184751d24177 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.619208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.702399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c2448-1abe-4003-9c33-184751d24177 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.752808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829284c6-503c-478d-861c-5ba5c275a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.753451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829284c6-503c-478d-861c-5ba5c275a67c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.753737 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829284c6-503c-478d-861c-5ba5c275a67c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.754016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829284c6-503c-478d-861c-5ba5c275a67c None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.754730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829284c6-503c-478d-861c-5ba5c275a67c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:24.755057 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829284c6-503c-478d-861c-5ba5c275a67c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:24.756559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829284c6-503c-478d-861c-5ba5c275a67c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:24.771475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 106/204] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:24.776999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a29ddc-f38e-430b-84ce-7e1b882904ad None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.821083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.927817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a29ddc-f38e-430b-84ce-7e1b882904ad None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.967092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e26b66-c66e-4840-bea8-f2caa9344012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.967731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e26b66-c66e-4840-bea8-f2caa9344012 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.968012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e26b66-c66e-4840-bea8-f2caa9344012 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.968369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e26b66-c66e-4840-bea8-f2caa9344012 None admin] PATH_INFO: `/v3/users/fef45bf8a1f745a5a52e9b4901b261cd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.975715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e26b66-c66e-4840-bea8-f2caa9344012 None admin] RBAC: Authorizing `identity:get_user(user_id=fef45bf8a1f745a5a52e9b4901b261cd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:24.977191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e26b66-c66e-4840-bea8-f2caa9344012 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:24.979102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 99/205] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/users/fef45bf8a1f745a5a52e9b4901b261cd => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:24.985272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829284c6-503c-478d-861c-5ba5c275a67c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.140335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.147552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829284c6-503c-478d-861c-5ba5c275a67c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.193078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe0921-e275-47a4-8d13-ff258cc86ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.193618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0921-e275-47a4-8d13-ff258cc86ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.193900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0921-e275-47a4-8d13-ff258cc86ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.194178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe0921-e275-47a4-8d13-ff258cc86ac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.289505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe0921-e275-47a4-8d13-ff258cc86ac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.290993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe0921-e275-47a4-8d13-ff258cc86ac7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.404776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.409008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 107/206] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:25.414771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e26b66-c66e-4840-bea8-f2caa9344012 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.539350 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.550453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e26b66-c66e-4840-bea8-f2caa9344012 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.594649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea6a3d-97f2-4609-b09b-cda951fa504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.595313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea6a3d-97f2-4609-b09b-cda951fa504a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.595621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea6a3d-97f2-4609-b09b-cda951fa504a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.595950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea6a3d-97f2-4609-b09b-cda951fa504a None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.599752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea6a3d-97f2-4609-b09b-cda951fa504a None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.601235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea6a3d-97f2-4609-b09b-cda951fa504a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.603152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 100/207] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:25.609210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe0921-e275-47a4-8d13-ff258cc86ac7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.682380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf904e-8956-46f4-905e-43fd7fe819cf None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.682698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf904e-8956-46f4-905e-43fd7fe819cf None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.682946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf904e-8956-46f4-905e-43fd7fe819cf None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.685160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 101/208] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:25.690183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a12948-efb9-4d2c-a706-e74d99a39294 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.690470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a12948-efb9-4d2c-a706-e74d99a39294 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.690747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a12948-efb9-4d2c-a706-e74d99a39294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.725723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f5a12948-efb9-4d2c-a706-e74d99a39294 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:25.727532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f5a12948-efb9-4d2c-a706-e74d99a39294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:25.744104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe0921-e275-47a4-8d13-ff258cc86ac7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.792172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d802c42-bb9c-4b78-ae7e-9495dc8ef908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.792710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802c42-bb9c-4b78-ae7e-9495dc8ef908 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.792988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802c42-bb9c-4b78-ae7e-9495dc8ef908 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.793263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802c42-bb9c-4b78-ae7e-9495dc8ef908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.794533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d802c42-bb9c-4b78-ae7e-9495dc8ef908 None admin] RBAC: Adding query filter params (role.id=699bd71b35c444f6b0f64e4e2b14b682, scope.project.id=680354d08b5e4597b80901494f3d923c, user.id=fef45bf8a1f745a5a52e9b4901b261cd) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:25.794847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d802c42-bb9c-4b78-ae7e-9495dc8ef908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.796332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d802c42-bb9c-4b78-ae7e-9495dc8ef908 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.808886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 108/209] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/role_assignments?user.id=fef45bf8a1f745a5a52e9b4901b261cd&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=699bd71b35c444f6b0f64e4e2b14b682 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:25.829586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 102/210] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:25.978406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741e1f-eba9-4a1a-aee3-6cbcbd0f6547 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.978736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741e1f-eba9-4a1a-aee3-6cbcbd0f6547 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.978949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741e1f-eba9-4a1a-aee3-6cbcbd0f6547 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.980467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 109/211] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:25.987168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74aebf-8f8f-4390-b84c-a92b626f8232 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.987459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74aebf-8f8f-4390-b84c-a92b626f8232 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.987739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74aebf-8f8f-4390-b84c-a92b626f8232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.012105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bb74aebf-8f8f-4390-b84c-a92b626f8232 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:26.013851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bb74aebf-8f8f-4390-b84c-a92b626f8232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:26.173117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 103/212] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:26.199540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19741e1f-eba9-4a1a-aee3-6cbcbd0f6547 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.269035 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.309878 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19741e1f-eba9-4a1a-aee3-6cbcbd0f6547 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.345750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca94ad-0428-43aa-aede-b7abbdef7545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.346394 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca94ad-0428-43aa-aede-b7abbdef7545 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.346675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca94ad-0428-43aa-aede-b7abbdef7545 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.346951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca94ad-0428-43aa-aede-b7abbdef7545 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.358370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca94ad-0428-43aa-aede-b7abbdef7545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-8dca94ad-0428-43aa-aede-b7abbdef7545 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:26.364759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:26.365654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:26.366645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 110/213] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:26.373016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74aebf-8f8f-4390-b84c-a92b626f8232 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.399113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.459936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca94ad-0428-43aa-aede-b7abbdef7545 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.480181 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74aebf-8f8f-4390-b84c-a92b626f8232 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.515276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138354d-8298-4656-83d2-e4bb08b603fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.515888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138354d-8298-4656-83d2-e4bb08b603fb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.516166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138354d-8298-4656-83d2-e4bb08b603fb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.516437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138354d-8298-4656-83d2-e4bb08b603fb None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.517109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138354d-8298-4656-83d2-e4bb08b603fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:26.517411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138354d-8298-4656-83d2-e4bb08b603fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138354d-8298-4656-83d2-e4bb08b603fb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.527914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 104/214] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:26.533508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138354d-8298-4656-83d2-e4bb08b603fb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.562086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca94ad-0428-43aa-aede-b7abbdef7545 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.587412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.597691 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3461a7-dcee-4140-b1dd-9bff4fe06c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.598348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3461a7-dcee-4140-b1dd-9bff4fe06c71 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.598626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3461a7-dcee-4140-b1dd-9bff4fe06c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.598913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3461a7-dcee-4140-b1dd-9bff4fe06c71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.600051 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3461a7-dcee-4140-b1dd-9bff4fe06c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.602620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3461a7-dcee-4140-b1dd-9bff4fe06c71 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.603206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 111/215] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:26.603206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2a6cf-5003-4d67-a0b1-d3337eab3790 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.603206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2a6cf-5003-4d67-a0b1-d3337eab3790 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.603206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2a6cf-5003-4d67-a0b1-d3337eab3790 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.603206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 112/216] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:26.611374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2a6cf-5003-4d67-a0b1-d3337eab3790 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.633777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.652548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138354d-8298-4656-83d2-e4bb08b603fb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.689566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15bf44-88f8-42d4-9c95-295a7d67c285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.690203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15bf44-88f8-42d4-9c95-295a7d67c285 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.690491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15bf44-88f8-42d4-9c95-295a7d67c285 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.690769 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15bf44-88f8-42d4-9c95-295a7d67c285 None admin] PATH_INFO: `/v3/users/e48593011a694e49a3466654813957b7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.704048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15bf44-88f8-42d4-9c95-295a7d67c285 None admin] RBAC: Authorizing `identity:get_user(user_id=e48593011a694e49a3466654813957b7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.705543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15bf44-88f8-42d4-9c95-295a7d67c285 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.707365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 105/217] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/users/e48593011a694e49a3466654813957b7 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:26.708358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0f593-bb24-42ce-a7da-90e983404c3c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.708637 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0f593-bb24-42ce-a7da-90e983404c3c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.708908 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0f593-bb24-42ce-a7da-90e983404c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.716271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2a6cf-5003-4d67-a0b1-d3337eab3790 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.725919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-02f0f593-bb24-42ce-a7da-90e983404c3c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:26.727127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-02f0f593-bb24-42ce-a7da-90e983404c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:26.750268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b17f1-3e0b-4d61-97c2-66ed6e78fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.750875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b17f1-3e0b-4d61-97c2-66ed6e78fd6a None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.751174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b17f1-3e0b-4d61-97c2-66ed6e78fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.751447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b17f1-3e0b-4d61-97c2-66ed6e78fd6a None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.752086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b17f1-3e0b-4d61-97c2-66ed6e78fd6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.753668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b17f1-3e0b-4d61-97c2-66ed6e78fd6a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.791884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 106/218] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:26.793115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098805-462f-4f06-9da1-d1d92aa72473 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.793400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098805-462f-4f06-9da1-d1d92aa72473 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.793671 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098805-462f-4f06-9da1-d1d92aa72473 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.795466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 107/219] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:26.796215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098805-462f-4f06-9da1-d1d92aa72473 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.860818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 113/220] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:26 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:26.862049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47e92-0cb3-4576-9d63-06c3e530d4ea None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.862337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47e92-0cb3-4576-9d63-06c3e530d4ea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.862611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47e92-0cb3-4576-9d63-06c3e530d4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.885493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4df47e92-0cb3-4576-9d63-06c3e530d4ea None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:26.886783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4df47e92-0cb3-4576-9d63-06c3e530d4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:26.889969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.930906 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098805-462f-4f06-9da1-d1d92aa72473 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.939040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.968140 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 114/221] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:26.976574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cf77d-d73b-4d95-88c6-aa5d279a6105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.977575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf77d-d73b-4d95-88c6-aa5d279a6105 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.978050 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf77d-d73b-4d95-88c6-aa5d279a6105 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.978511 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf77d-d73b-4d95-88c6-aa5d279a6105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.055147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cf77d-d73b-4d95-88c6-aa5d279a6105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.057010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cf77d-d73b-4d95-88c6-aa5d279a6105 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.064371 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47e92-0cb3-4576-9d63-06c3e530d4ea None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.155939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.198165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 108/222] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:27.198350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47e92-0cb3-4576-9d63-06c3e530d4ea None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.205279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cf77d-d73b-4d95-88c6-aa5d279a6105 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.249081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3034a-9087-437c-9f29-9175dd4ea78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.249653 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3034a-9087-437c-9f29-9175dd4ea78a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.249942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3034a-9087-437c-9f29-9175dd4ea78a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.250227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3034a-9087-437c-9f29-9175dd4ea78a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.266631 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3034a-9087-437c-9f29-9175dd4ea78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-40b3034a-9087-437c-9f29-9175dd4ea78a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:27.272943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:27.273829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:27.274622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:27.275697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 115/223] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:27.282144 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3034a-9087-437c-9f29-9175dd4ea78a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.328168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.344762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cf77d-d73b-4d95-88c6-aa5d279a6105 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.383651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3896fef-55f9-4e83-b276-4ffc71c79eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.384304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3896fef-55f9-4e83-b276-4ffc71c79eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.384581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3896fef-55f9-4e83-b276-4ffc71c79eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.384854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3896fef-55f9-4e83-b276-4ffc71c79eb1 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.386016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3896fef-55f9-4e83-b276-4ffc71c79eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.387530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3896fef-55f9-4e83-b276-4ffc71c79eb1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.389531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 109/224] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:27.390313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3896fef-55f9-4e83-b276-4ffc71c79eb1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.412409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3034a-9087-437c-9f29-9175dd4ea78a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.449582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fe920-83fe-4d59-b9b7-ffe18052e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.450730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe920-83fe-4d59-b9b7-ffe18052e198 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.451012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe920-83fe-4d59-b9b7-ffe18052e198 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.451313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe920-83fe-4d59-b9b7-ffe18052e198 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.451986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fe920-83fe-4d59-b9b7-ffe18052e198 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:27.452290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fe920-83fe-4d59-b9b7-ffe18052e198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.452392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.454159 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fe920-83fe-4d59-b9b7-ffe18052e198 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.463493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 116/225] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:27.469191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fe920-83fe-4d59-b9b7-ffe18052e198 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.522409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3896fef-55f9-4e83-b276-4ffc71c79eb1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.559583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67474ea3-43e1-4bf9-bbf7-02e0e94734bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.560233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67474ea3-43e1-4bf9-bbf7-02e0e94734bf None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.560517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67474ea3-43e1-4bf9-bbf7-02e0e94734bf None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.560794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67474ea3-43e1-4bf9-bbf7-02e0e94734bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.571821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67474ea3-43e1-4bf9-bbf7-02e0e94734bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-67474ea3-43e1-4bf9-bbf7-02e0e94734bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:27.577331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:27.578233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:27.579067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 110/226] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:27.580052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.584029 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67474ea3-43e1-4bf9-bbf7-02e0e94734bf None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.585047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fe920-83fe-4d59-b9b7-ffe18052e198 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.621625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ab671-97ae-4edf-829b-fa8e54640479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.622984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ab671-97ae-4edf-829b-fa8e54640479 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.623430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ab671-97ae-4edf-829b-fa8e54640479 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.623849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ab671-97ae-4edf-829b-fa8e54640479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.624756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ab671-97ae-4edf-829b-fa8e54640479 None admin] RBAC: Adding query filter params (role.id=8689bf0d70184aef9148c6b4a9758b32, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b, user.id=e48593011a694e49a3466654813957b7) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:27.625221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ab671-97ae-4edf-829b-fa8e54640479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.626823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ab671-97ae-4edf-829b-fa8e54640479 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.634675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 117/227] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/role_assignments?user.id=e48593011a694e49a3466654813957b7&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:27.635750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ab671-97ae-4edf-829b-fa8e54640479 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.697928 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67474ea3-43e1-4bf9-bbf7-02e0e94734bf None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.699924 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.738116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830465b2-7984-4aa7-8bf6-c627f931951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.739025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830465b2-7984-4aa7-8bf6-c627f931951e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.739344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830465b2-7984-4aa7-8bf6-c627f931951e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.739624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830465b2-7984-4aa7-8bf6-c627f931951e None admin] PATH_INFO: `/v3/users/fd0bdd33ada34a5aa674a2501e56215f` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.741303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830465b2-7984-4aa7-8bf6-c627f931951e None admin] RBAC: Authorizing `identity:get_user(user_id=fd0bdd33ada34a5aa674a2501e56215f)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.742817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830465b2-7984-4aa7-8bf6-c627f931951e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.749992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 111/228] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/users/fd0bdd33ada34a5aa674a2501e56215f => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:27.751400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830465b2-7984-4aa7-8bf6-c627f931951e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.860921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830465b2-7984-4aa7-8bf6-c627f931951e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.897793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbccbff-38b3-4f75-9676-50a75b39d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.898435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbccbff-38b3-4f75-9676-50a75b39d549 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.898717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbccbff-38b3-4f75-9676-50a75b39d549 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.898990 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbccbff-38b3-4f75-9676-50a75b39d549 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.900218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbccbff-38b3-4f75-9676-50a75b39d549 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.901810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbccbff-38b3-4f75-9676-50a75b39d549 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.907923 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 112/229] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:27.910080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbccbff-38b3-4f75-9676-50a75b39d549 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.928299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ab671-97ae-4edf-829b-fa8e54640479 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.950935 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:28.016450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1f6fc-b185-4980-ad3b-18a78801c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:28.017429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1f6fc-b185-4980-ad3b-18a78801c16b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:28.017909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1f6fc-b185-4980-ad3b-18a78801c16b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:28.018402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1f6fc-b185-4980-ad3b-18a78801c16b None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:28.019294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1f6fc-b185-4980-ad3b-18a78801c16b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:28.019755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbccbff-38b3-4f75-9676-50a75b39d549 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:28.020019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1f6fc-b185-4980-ad3b-18a78801c16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:28.021596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1f6fc-b185-4980-ad3b-18a78801c16b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:28.042146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 118/230] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:28.058555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1f6fc-b185-4980-ad3b-18a78801c16b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:28.060906 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2bcf3-e7b3-4168-a356-533e401d0cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:28.061641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bcf3-e7b3-4168-a356-533e401d0cbd None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:28.065369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bcf3-e7b3-4168-a356-533e401d0cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:28.065369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2bcf3-e7b3-4168-a356-533e401d0cbd None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/users/fd0bdd33ada34a5aa674a2501e56215f/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:28.071070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2bcf3-e7b3-4168-a356-533e401d0cbd None admin] RBAC: Authorizing `identity:create_grant(project_id=ce37eeb36b8d44b0ae5c523d52045e8b, user_id=fd0bdd33ada34a5aa674a2501e56215f, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:28.071070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2bcf3-e7b3-4168-a356-533e401d0cbd None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:28.098305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:28.156021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 113/231] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:27 2022] PUT /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/users/fd0bdd33ada34a5aa674a2501e56215f/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:28.206352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1f6fc-b185-4980-ad3b-18a78801c16b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:28.250843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b2a3-d784-4523-82bf-77bdafbadac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:28.251541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b2a3-d784-4523-82bf-77bdafbadac9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:28.251827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b2a3-d784-4523-82bf-77bdafbadac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:28.252106 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b2a3-d784-4523-82bf-77bdafbadac9 None admin] PATH_INFO: `/v3/users/fd0bdd33ada34a5aa674a2501e56215f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:28.255970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1b2a3-d784-4523-82bf-77bdafbadac9 None admin] RBAC: Authorizing `identity:get_user(user_id=fd0bdd33ada34a5aa674a2501e56215f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:28.257566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1b2a3-d784-4523-82bf-77bdafbadac9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:28.259754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 119/232] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:28 2022] GET /identity/v3/users/fd0bdd33ada34a5aa674a2501e56215f => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:28.265845 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2bcf3-e7b3-4168-a356-533e401d0cbd None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:28.394703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:28.401305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2bcf3-e7b3-4168-a356-533e401d0cbd None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:28.440981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b08ac-53f0-499d-aea4-1b8fb6889dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:28.441554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b08ac-53f0-499d-aea4-1b8fb6889dcc None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:28.441834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b08ac-53f0-499d-aea4-1b8fb6889dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:28.442109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b08ac-53f0-499d-aea4-1b8fb6889dcc None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:28.443295 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b08ac-53f0-499d-aea4-1b8fb6889dcc None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:28.444745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b08ac-53f0-499d-aea4-1b8fb6889dcc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:28.446394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 114/233] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:28 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:28.452572 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b2a3-d784-4523-82bf-77bdafbadac9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:28.605416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:28.614180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b2a3-d784-4523-82bf-77bdafbadac9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:28.661134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229143b-7c38-4fd0-9cfa-fa7498a98c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:28.661813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229143b-7c38-4fd0-9cfa-fa7498a98c34 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:28.662097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229143b-7c38-4fd0-9cfa-fa7498a98c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:28.662434 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229143b-7c38-4fd0-9cfa-fa7498a98c34 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/users/fd0bdd33ada34a5aa674a2501e56215f/roles/0abc70600d6f4948a59e9a14d33aa289` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:28.664896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229143b-7c38-4fd0-9cfa-fa7498a98c34 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce37eeb36b8d44b0ae5c523d52045e8b, user_id=fd0bdd33ada34a5aa674a2501e56215f, role_id=0abc70600d6f4948a59e9a14d33aa289)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:28.666378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229143b-7c38-4fd0-9cfa-fa7498a98c34 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:28.762775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 120/234] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:28 2022] PUT /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/users/fd0bdd33ada34a5aa674a2501e56215f/roles/0abc70600d6f4948a59e9a14d33aa289 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:29.276495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90acba5-17fd-4f7f-a1f8-48bcd34b14a3 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.277512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90acba5-17fd-4f7f-a1f8-48bcd34b14a3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.278555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90acba5-17fd-4f7f-a1f8-48bcd34b14a3 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.280167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 115/235] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:29.285624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf52fa-8303-4e31-886e-c6c204c4d9ec None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.286163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf52fa-8303-4e31-886e-c6c204c4d9ec None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.286654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf52fa-8303-4e31-886e-c6c204c4d9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.310136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0dcf52fa-8303-4e31-886e-c6c204c4d9ec None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:29.311702 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0dcf52fa-8303-4e31-886e-c6c204c4d9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:29.401982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 121/236] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:29.579095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999bf2-306f-4fc5-b2c9-c51734776b81 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.579727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999bf2-306f-4fc5-b2c9-c51734776b81 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.580227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999bf2-306f-4fc5-b2c9-c51734776b81 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.581781 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 116/237] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:29.596952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038fd0-4fd0-4627-a055-d31a0309fc00 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.597578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038fd0-4fd0-4627-a055-d31a0309fc00 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.598055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038fd0-4fd0-4627-a055-d31a0309fc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.623173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f9038fd0-4fd0-4627-a055-d31a0309fc00 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:29.624776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f9038fd0-4fd0-4627-a055-d31a0309fc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:29.721366 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 122/238] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:29.860988 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ae338-688f-4f5e-81de-068d94ae558f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.861598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ae338-688f-4f5e-81de-068d94ae558f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.862093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ae338-688f-4f5e-81de-068d94ae558f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.869133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 117/239] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:29.874783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12405c26-8b5d-4b4c-87e9-983ea55d1737 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.875336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12405c26-8b5d-4b4c-87e9-983ea55d1737 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.875816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12405c26-8b5d-4b4c-87e9-983ea55d1737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.894618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-12405c26-8b5d-4b4c-87e9-983ea55d1737 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:29.896205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-12405c26-8b5d-4b4c-87e9-983ea55d1737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:29.904724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:29.913975 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ae338-688f-4f5e-81de-068d94ae558f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.021899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 123/240] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:30.069320 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ae338-688f-4f5e-81de-068d94ae558f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.078863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12405c26-8b5d-4b4c-87e9-983ea55d1737 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.147801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287994c5-1ae1-4fb3-a5db-85f66df62304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.148368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287994c5-1ae1-4fb3-a5db-85f66df62304 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.148646 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287994c5-1ae1-4fb3-a5db-85f66df62304 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.148915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287994c5-1ae1-4fb3-a5db-85f66df62304 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.162719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287994c5-1ae1-4fb3-a5db-85f66df62304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-287994c5-1ae1-4fb3-a5db-85f66df62304 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:30.167560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:30.168503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:30.169310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 118/241] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:30.174199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287994c5-1ae1-4fb3-a5db-85f66df62304 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.234347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.286046 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12405c26-8b5d-4b4c-87e9-983ea55d1737 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.328687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d829dd4-1b7e-4b50-af20-24242c72721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.329665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d829dd4-1b7e-4b50-af20-24242c72721a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.330122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d829dd4-1b7e-4b50-af20-24242c72721a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.330399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d829dd4-1b7e-4b50-af20-24242c72721a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.331867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d829dd4-1b7e-4b50-af20-24242c72721a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.333662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d829dd4-1b7e-4b50-af20-24242c72721a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.336391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 124/242] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:30.337274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d829dd4-1b7e-4b50-af20-24242c72721a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.353077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.382167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287994c5-1ae1-4fb3-a5db-85f66df62304 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.432298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e9cd-20f3-4c6c-9e84-509950e32c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.432841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e9cd-20f3-4c6c-9e84-509950e32c18 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.433122 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e9cd-20f3-4c6c-9e84-509950e32c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.433397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e9cd-20f3-4c6c-9e84-509950e32c18 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.434072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529e9cd-20f3-4c6c-9e84-509950e32c18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:30.434965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529e9cd-20f3-4c6c-9e84-509950e32c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.437067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529e9cd-20f3-4c6c-9e84-509950e32c18 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.447680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d829dd4-1b7e-4b50-af20-24242c72721a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.448090 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 119/243] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:30.448905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e9cd-20f3-4c6c-9e84-509950e32c18 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.491135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1213d-cf22-45f9-ade0-d90504fbe7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.491837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1213d-cf22-45f9-ade0-d90504fbe7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.492122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1213d-cf22-45f9-ade0-d90504fbe7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.492400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1213d-cf22-45f9-ade0-d90504fbe7b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.506837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1213d-cf22-45f9-ade0-d90504fbe7b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c2f1213d-cf22-45f9-ade0-d90504fbe7b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:30.514261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:30.515429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:30.516237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 125/244] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:30.517657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1213d-cf22-45f9-ade0-d90504fbe7b9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.546677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.561849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e9cd-20f3-4c6c-9e84-509950e32c18 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.594837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.599318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f38e0-15ab-4c7f-af31-8956d7bec076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.599933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f38e0-15ab-4c7f-af31-8956d7bec076 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.600213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f38e0-15ab-4c7f-af31-8956d7bec076 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.600482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f38e0-15ab-4c7f-af31-8956d7bec076 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.601127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f38e0-15ab-4c7f-af31-8956d7bec076 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.602572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f38e0-15ab-4c7f-af31-8956d7bec076 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.627147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1213d-cf22-45f9-ade0-d90504fbe7b9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.661900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862c4cd-a6c7-493a-88db-a396c2cb988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.662533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c4cd-a6c7-493a-88db-a396c2cb988e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.662820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c4cd-a6c7-493a-88db-a396c2cb988e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.663135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c4cd-a6c7-493a-88db-a396c2cb988e None admin] PATH_INFO: `/v3/users/2b2d2fe451634e4da1d9bf38ce3d4379` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.676293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862c4cd-a6c7-493a-88db-a396c2cb988e None admin] RBAC: Authorizing `identity:get_user(user_id=2b2d2fe451634e4da1d9bf38ce3d4379)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.677779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862c4cd-a6c7-493a-88db-a396c2cb988e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.679699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 126/245] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/users/2b2d2fe451634e4da1d9bf38ce3d4379 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:30.680866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a635b3-f5db-4c96-9905-ec48d92908d9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.681154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a635b3-f5db-4c96-9905-ec48d92908d9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.681429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a635b3-f5db-4c96-9905-ec48d92908d9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.682876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 127/246] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:30.687782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a635b3-f5db-4c96-9905-ec48d92908d9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.703083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 120/247] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:30 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:30.703083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f38e0-15ab-4c7f-af31-8956d7bec076 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.817549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a635b3-f5db-4c96-9905-ec48d92908d9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.851266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.855599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f38e0-15ab-4c7f-af31-8956d7bec076 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.866816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1dcf2-2e88-4087-82fb-8153b1aad6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.867789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1dcf2-2e88-4087-82fb-8153b1aad6db None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.868454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1dcf2-2e88-4087-82fb-8153b1aad6db None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.868559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1dcf2-2e88-4087-82fb-8153b1aad6db None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.869192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1dcf2-2e88-4087-82fb-8153b1aad6db None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:30.872086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1dcf2-2e88-4087-82fb-8153b1aad6db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.872086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1dcf2-2e88-4087-82fb-8153b1aad6db None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.881673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 128/248] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:30.883209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70f537-6a78-4aa0-8241-56cdaca71141 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.883494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70f537-6a78-4aa0-8241-56cdaca71141 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.883764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70f537-6a78-4aa0-8241-56cdaca71141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.902491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111be5f4-3ae1-46d1-8435-85fff0e019bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.903978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111be5f4-3ae1-46d1-8435-85fff0e019bd None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.904300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111be5f4-3ae1-46d1-8435-85fff0e019bd None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.904539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111be5f4-3ae1-46d1-8435-85fff0e019bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.908845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8c70f537-6a78-4aa0-8241-56cdaca71141 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:30.910088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8c70f537-6a78-4aa0-8241-56cdaca71141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:30.917480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.998222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111be5f4-3ae1-46d1-8435-85fff0e019bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.999789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111be5f4-3ae1-46d1-8435-85fff0e019bd None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.002226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 129/249] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:31.002874 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70f537-6a78-4aa0-8241-56cdaca71141 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.114438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70f537-6a78-4aa0-8241-56cdaca71141 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.121030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 121/250] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:31.129494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111be5f4-3ae1-46d1-8435-85fff0e019bd None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.149331 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.169918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d375d3-1eb9-4468-afb3-ea69be532c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.170557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d375d3-1eb9-4468-afb3-ea69be532c6b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.170900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d375d3-1eb9-4468-afb3-ea69be532c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.171202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d375d3-1eb9-4468-afb3-ea69be532c6b None admin] PATH_INFO: `/v3/users/e48593011a694e49a3466654813957b7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.173067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d375d3-1eb9-4468-afb3-ea69be532c6b None admin] RBAC: Authorizing `identity:get_user(user_id=e48593011a694e49a3466654813957b7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.175706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d375d3-1eb9-4468-afb3-ea69be532c6b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.177931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 130/251] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/users/e48593011a694e49a3466654813957b7 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:31.180089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbeba5-588c-42ef-a15b-054df798ab3c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.180615 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbeba5-588c-42ef-a15b-054df798ab3c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.181113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbeba5-588c-42ef-a15b-054df798ab3c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.183272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 131/252] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:31.183734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.184932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbeba5-588c-42ef-a15b-054df798ab3c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.251814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111be5f4-3ae1-46d1-8435-85fff0e019bd None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.286865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237a37b-f076-45a6-a451-b0d3d6f65f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.287562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a37b-f076-45a6-a451-b0d3d6f65f60 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.287840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a37b-f076-45a6-a451-b0d3d6f65f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.288129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a37b-f076-45a6-a451-b0d3d6f65f60 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.289491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237a37b-f076-45a6-a451-b0d3d6f65f60 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.290689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237a37b-f076-45a6-a451-b0d3d6f65f60 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.292361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 122/253] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:31.294105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b7a18-464c-44ba-8bec-ed589e36727f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.294641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b7a18-464c-44ba-8bec-ed589e36727f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.299450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b7a18-464c-44ba-8bec-ed589e36727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.320681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8a8b7a18-464c-44ba-8bec-ed589e36727f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:31.321944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8a8b7a18-464c-44ba-8bec-ed589e36727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:31.332493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbeba5-588c-42ef-a15b-054df798ab3c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.384873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bf4fb-d375-41b8-9027-0e3e489bc442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.385530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bf4fb-d375-41b8-9027-0e3e489bc442 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.385860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bf4fb-d375-41b8-9027-0e3e489bc442 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.386127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bf4fb-d375-41b8-9027-0e3e489bc442 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.387443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bf4fb-d375-41b8-9027-0e3e489bc442 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.389192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bf4fb-d375-41b8-9027-0e3e489bc442 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.391449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 132/254] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:31.392228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bf4fb-d375-41b8-9027-0e3e489bc442 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.410877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 123/255] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:31.415913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b7a18-464c-44ba-8bec-ed589e36727f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.495304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.508115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.581357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bf4fb-d375-41b8-9027-0e3e489bc442 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.599957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b7a18-464c-44ba-8bec-ed589e36727f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.657071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b3e37-51e5-4371-bc9d-43d7ba2a830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.657715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3e37-51e5-4371-bc9d-43d7ba2a830a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.657998 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3e37-51e5-4371-bc9d-43d7ba2a830a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.658754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3e37-51e5-4371-bc9d-43d7ba2a830a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.662437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda04a29-00fe-4c3c-bc51-5a93e76dd6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.663488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04a29-00fe-4c3c-bc51-5a93e76dd6fb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.663987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04a29-00fe-4c3c-bc51-5a93e76dd6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.664485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04a29-00fe-4c3c-bc51-5a93e76dd6fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.665855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda04a29-00fe-4c3c-bc51-5a93e76dd6fb None admin] RBAC: Adding query filter params (role.id=699bd71b35c444f6b0f64e4e2b14b682, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b, user.id=2b2d2fe451634e4da1d9bf38ce3d4379) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:31.666425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda04a29-00fe-4c3c-bc51-5a93e76dd6fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.669412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda04a29-00fe-4c3c-bc51-5a93e76dd6fb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.683473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b3e37-51e5-4371-bc9d-43d7ba2a830a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-2d0b3e37-51e5-4371-bc9d-43d7ba2a830a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:31.688851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:31.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:31.690532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 124/256] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:31.691788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b3e37-51e5-4371-bc9d-43d7ba2a830a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.691858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 133/257] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/role_assignments?user.id=2b2d2fe451634e4da1d9bf38ce3d4379&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=699bd71b35c444f6b0f64e4e2b14b682 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:31.697760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda04a29-00fe-4c3c-bc51-5a93e76dd6fb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.826211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda04a29-00fe-4c3c-bc51-5a93e76dd6fb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.854475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.876913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461918f9-36c3-4402-9611-2d23e954d64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.877766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461918f9-36c3-4402-9611-2d23e954d64c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.880287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461918f9-36c3-4402-9611-2d23e954d64c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.880287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461918f9-36c3-4402-9611-2d23e954d64c None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.880287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461918f9-36c3-4402-9611-2d23e954d64c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:31.880287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461918f9-36c3-4402-9611-2d23e954d64c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.880989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461918f9-36c3-4402-9611-2d23e954d64c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.892410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 134/258] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:31.893078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461918f9-36c3-4402-9611-2d23e954d64c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.936858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.940486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b3e37-51e5-4371-bc9d-43d7ba2a830a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.017263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07383167-b2f3-40c2-8b58-d0bdc2c139cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.017932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07383167-b2f3-40c2-8b58-d0bdc2c139cc None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.018214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07383167-b2f3-40c2-8b58-d0bdc2c139cc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.018492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07383167-b2f3-40c2-8b58-d0bdc2c139cc None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/users/e48593011a694e49a3466654813957b7/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.030285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07383167-b2f3-40c2-8b58-d0bdc2c139cc None admin] RBAC: Authorizing `identity:create_grant(project_id=ce37eeb36b8d44b0ae5c523d52045e8b, user_id=e48593011a694e49a3466654813957b7, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:32.030285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07383167-b2f3-40c2-8b58-d0bdc2c139cc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:32.080245 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461918f9-36c3-4402-9611-2d23e954d64c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.128453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851c9b2-f81c-4e7a-9767-8c06c6f695b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.132619 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 125/259] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:31 2022] PUT /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/users/e48593011a694e49a3466654813957b7/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:32.133454 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07383167-b2f3-40c2-8b58-d0bdc2c139cc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.133557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c9b2-f81c-4e7a-9767-8c06c6f695b7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.136113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c9b2-f81c-4e7a-9767-8c06c6f695b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.136557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851c9b2-f81c-4e7a-9767-8c06c6f695b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.180781 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851c9b2-f81c-4e7a-9767-8c06c6f695b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-2851c9b2-f81c-4e7a-9767-8c06c6f695b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:32.196803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:32.197763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:32.198540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 135/260] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:32.206783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851c9b2-f81c-4e7a-9767-8c06c6f695b7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.390397 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:32.566450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851c9b2-f81c-4e7a-9767-8c06c6f695b7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.594490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07383167-b2f3-40c2-8b58-d0bdc2c139cc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.681218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7805265-c6c5-46c4-85ed-dd67c29855c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.683727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7805265-c6c5-46c4-85ed-dd67c29855c7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.684064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7805265-c6c5-46c4-85ed-dd67c29855c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.686104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cb0da-f3f4-40e9-961d-4e9e3ebe72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.686720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb0da-f3f4-40e9-961d-4e9e3ebe72fc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.686996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb0da-f3f4-40e9-961d-4e9e3ebe72fc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.687294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb0da-f3f4-40e9-961d-4e9e3ebe72fc None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.687966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cb0da-f3f4-40e9-961d-4e9e3ebe72fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:32.688270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cb0da-f3f4-40e9-961d-4e9e3ebe72fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:32.689680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cb0da-f3f4-40e9-961d-4e9e3ebe72fc None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:32.691690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7805265-c6c5-46c4-85ed-dd67c29855c7 None admin] PATH_INFO: `/v3/users/fd0bdd33ada34a5aa674a2501e56215f` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.693247 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7805265-c6c5-46c4-85ed-dd67c29855c7 None admin] RBAC: Authorizing `identity:get_user(user_id=fd0bdd33ada34a5aa674a2501e56215f)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:32.695028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7805265-c6c5-46c4-85ed-dd67c29855c7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:32.696893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 126/261] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:32 2022] GET /identity/v3/users/fd0bdd33ada34a5aa674a2501e56215f => generated 283 bytes in 564 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:32.706114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7805265-c6c5-46c4-85ed-dd67c29855c7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.722003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 136/262] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:32.724996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cb0da-f3f4-40e9-961d-4e9e3ebe72fc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.794433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:32.958401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7805265-c6c5-46c4-85ed-dd67c29855c7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:33.000430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9039229-056e-48a9-a899-24ac63e3d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:33.001166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9039229-056e-48a9-a899-24ac63e3d352 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.001454 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9039229-056e-48a9-a899-24ac63e3d352 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.001734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9039229-056e-48a9-a899-24ac63e3d352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.045271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cb0da-f3f4-40e9-961d-4e9e3ebe72fc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:33.052150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:33.074508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9039229-056e-48a9-a899-24ac63e3d352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:33.076097 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9039229-056e-48a9-a899-24ac63e3d352 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:33.122149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ef1af-b969-44f5-ba2a-cc059b4c190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:33.123039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ef1af-b969-44f5-ba2a-cc059b4c190f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.123484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ef1af-b969-44f5-ba2a-cc059b4c190f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.123925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ef1af-b969-44f5-ba2a-cc059b4c190f None admin] PATH_INFO: `/v3/users/fd0bdd33ada34a5aa674a2501e56215f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.127086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ef1af-b969-44f5-ba2a-cc059b4c190f None admin] RBAC: Authorizing `identity:get_user(user_id=fd0bdd33ada34a5aa674a2501e56215f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:33.128732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ef1af-b969-44f5-ba2a-cc059b4c190f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:33.130566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 137/263] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:32 2022] GET /identity/v3/users/fd0bdd33ada34a5aa674a2501e56215f => generated 283 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:33.145065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ef1af-b969-44f5-ba2a-cc059b4c190f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:33.171412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:33.319553 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ef1af-b969-44f5-ba2a-cc059b4c190f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:33.333281 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 127/264] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:33.335225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e63c2-9888-4428-83b8-522344f1358b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.335820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e63c2-9888-4428-83b8-522344f1358b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.336298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e63c2-9888-4428-83b8-522344f1358b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.343267 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 128/265] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:33.344175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e63c2-9888-4428-83b8-522344f1358b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:33.370111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d93f0d-fd96-4d51-bfb8-91416b12c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:33.371239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93f0d-fd96-4d51-bfb8-91416b12c36c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.372443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93f0d-fd96-4d51-bfb8-91416b12c36c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.373094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93f0d-fd96-4d51-bfb8-91416b12c36c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.443723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:33.482983 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d93f0d-fd96-4d51-bfb8-91416b12c36c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:33.485274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d93f0d-fd96-4d51-bfb8-91416b12c36c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:33.544846 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e63c2-9888-4428-83b8-522344f1358b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:33.572569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:33.580821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f385ea2-d19f-4f29-bbee-7bcd459e0af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:33.581628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f385ea2-d19f-4f29-bbee-7bcd459e0af4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.581802 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f385ea2-d19f-4f29-bbee-7bcd459e0af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.582159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f385ea2-d19f-4f29-bbee-7bcd459e0af4 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.586525 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f385ea2-d19f-4f29-bbee-7bcd459e0af4 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:33.586525 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f385ea2-d19f-4f29-bbee-7bcd459e0af4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:33.586948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 129/266] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:33 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:33.592702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fee32-153c-46c2-ac05-7b1cf279edc6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.592950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fee32-153c-46c2-ac05-7b1cf279edc6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.593227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fee32-153c-46c2-ac05-7b1cf279edc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.596688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 138/267] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:33.598263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2bb70-9dbf-4bc0-b644-00be7013ade5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.598781 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2bb70-9dbf-4bc0-b644-00be7013ade5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.599273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2bb70-9dbf-4bc0-b644-00be7013ade5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.601058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 139/268] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:33.602025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2bb70-9dbf-4bc0-b644-00be7013ade5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:33.618165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a53fee32-153c-46c2-ac05-7b1cf279edc6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:33.619397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a53fee32-153c-46c2-ac05-7b1cf279edc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:33.696598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:33.711864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 130/269] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:33.712384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fee32-153c-46c2-ac05-7b1cf279edc6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:33.751335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2bb70-9dbf-4bc0-b644-00be7013ade5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:33.789770 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e8923-5693-4a2a-9e02-db57a857e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:33.790502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e8923-5693-4a2a-9e02-db57a857e187 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.790790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e8923-5693-4a2a-9e02-db57a857e187 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.791097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e8923-5693-4a2a-9e02-db57a857e187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.791866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e8923-5693-4a2a-9e02-db57a857e187 None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b, user.id=fd0bdd33ada34a5aa674a2501e56215f) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:33.792178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e8923-5693-4a2a-9e02-db57a857e187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:33.794071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e8923-5693-4a2a-9e02-db57a857e187 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:33.801465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 140/270] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:33 2022] GET /identity/v3/role_assignments?user.id=fd0bdd33ada34a5aa674a2501e56215f&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:33.802826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570acfd-ff1f-4e55-b928-467875e9392c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.803159 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570acfd-ff1f-4e55-b928-467875e9392c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.803440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570acfd-ff1f-4e55-b928-467875e9392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.825817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a570acfd-ff1f-4e55-b928-467875e9392c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:33.827540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a570acfd-ff1f-4e55-b928-467875e9392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:33.917792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 141/271] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:33.931405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fee32-153c-46c2-ac05-7b1cf279edc6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:33.960916 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:33.978669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbb04b-f98f-427d-b568-0d516f5bb3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:33.979361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbb04b-f98f-427d-b568-0d516f5bb3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.979637 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbb04b-f98f-427d-b568-0d516f5bb3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.979914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbb04b-f98f-427d-b568-0d516f5bb3d4 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.984011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbb04b-f98f-427d-b568-0d516f5bb3d4 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:33.992874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbb04b-f98f-427d-b568-0d516f5bb3d4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:33.992874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 131/272] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:33 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:33.993991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570acfd-ff1f-4e55-b928-467875e9392c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.095489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.133481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570acfd-ff1f-4e55-b928-467875e9392c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.169287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544780a-ac36-4c42-8953-df21f8a349f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.169900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544780a-ac36-4c42-8953-df21f8a349f7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.170186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544780a-ac36-4c42-8953-df21f8a349f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.170462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544780a-ac36-4c42-8953-df21f8a349f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.171286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544780a-ac36-4c42-8953-df21f8a349f7 None admin] RBAC: Adding query filter params (role.id=0abc70600d6f4948a59e9a14d33aa289, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b, user.id=fd0bdd33ada34a5aa674a2501e56215f) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:34.171596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544780a-ac36-4c42-8953-df21f8a349f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:34.173113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544780a-ac36-4c42-8953-df21f8a349f7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:34.179529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 142/273] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:33 2022] GET /identity/v3/role_assignments?user.id=fd0bdd33ada34a5aa674a2501e56215f&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=0abc70600d6f4948a59e9a14d33aa289 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:34.219535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbb04b-f98f-427d-b568-0d516f5bb3d4 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.260000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544780a-ac36-4c42-8953-df21f8a349f7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.384017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbb04b-f98f-427d-b568-0d516f5bb3d4 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.388731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544780a-ac36-4c42-8953-df21f8a349f7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.433019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.433643 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dcc45-0c9c-4967-ba27-11386042d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.434830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dcc45-0c9c-4967-ba27-11386042d42b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.435174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dcc45-0c9c-4967-ba27-11386042d42b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.435457 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dcc45-0c9c-4967-ba27-11386042d42b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.436600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dcc45-0c9c-4967-ba27-11386042d42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:34.438054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dcc45-0c9c-4967-ba27-11386042d42b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:34.439871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 132/274] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:34.447223 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6819ab3-aced-445e-8142-28d3ef66bd3b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.447347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a3da6-e5d6-4cf2-a09e-2867770de4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.447471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6819ab3-aced-445e-8142-28d3ef66bd3b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.447471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6819ab3-aced-445e-8142-28d3ef66bd3b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.447626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a3da6-e5d6-4cf2-a09e-2867770de4bd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.447626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a3da6-e5d6-4cf2-a09e-2867770de4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.447626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a3da6-e5d6-4cf2-a09e-2867770de4bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.447844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 133/275] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:34.449326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6819ab3-aced-445e-8142-28d3ef66bd3b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.456057 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a3da6-e5d6-4cf2-a09e-2867770de4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ed6a3da6-e5d6-4cf2-a09e-2867770de4bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:34.461310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:34.462398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:34.463410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:34.466682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 143/276] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:34.468138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450e50-db3a-48c8-8dba-e90e5cdef9dc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.468422 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450e50-db3a-48c8-8dba-e90e5cdef9dc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.468696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450e50-db3a-48c8-8dba-e90e5cdef9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.489985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c7450e50-db3a-48c8-8dba-e90e5cdef9dc None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:34.491364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c7450e50-db3a-48c8-8dba-e90e5cdef9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:34.540917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.585975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 144/277] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:34.586944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7450e50-db3a-48c8-8dba-e90e5cdef9dc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.595393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6819ab3-aced-445e-8142-28d3ef66bd3b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.632940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3df4f0-2d06-41e5-8e99-3a3a2a73afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.633691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3df4f0-2d06-41e5-8e99-3a3a2a73afcd None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.633921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3df4f0-2d06-41e5-8e99-3a3a2a73afcd None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.634163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3df4f0-2d06-41e5-8e99-3a3a2a73afcd None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.634720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3df4f0-2d06-41e5-8e99-3a3a2a73afcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:34.636234 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3df4f0-2d06-41e5-8e99-3a3a2a73afcd None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:34.715892 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 134/278] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:34 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:26:34.717420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7450e50-db3a-48c8-8dba-e90e5cdef9dc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.748300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.765328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896d6f0-dbb3-410c-ba5b-73e770a4d40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.766101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d6f0-dbb3-410c-ba5b-73e770a4d40e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.766386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d6f0-dbb3-410c-ba5b-73e770a4d40e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.766662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d6f0-dbb3-410c-ba5b-73e770a4d40e None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.767544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896d6f0-dbb3-410c-ba5b-73e770a4d40e None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:34.767866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896d6f0-dbb3-410c-ba5b-73e770a4d40e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:34.769345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896d6f0-dbb3-410c-ba5b-73e770a4d40e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:34.779925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 145/279] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:34.786365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3df4f0-2d06-41e5-8e99-3a3a2a73afcd None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.856620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33c6e-6bb1-457d-ab3c-6d16a633f299 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.856928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33c6e-6bb1-457d-ab3c-6d16a633f299 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.857172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33c6e-6bb1-457d-ab3c-6d16a633f299 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.858809 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 146/280] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:34.864803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35d6d9-56f6-4b20-ad07-d18ded139a80 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.865110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35d6d9-56f6-4b20-ad07-d18ded139a80 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.865385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35d6d9-56f6-4b20-ad07-d18ded139a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.885194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-be35d6d9-56f6-4b20-ad07-d18ded139a80 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:34.886634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be35d6d9-56f6-4b20-ad07-d18ded139a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:34.905612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3df4f0-2d06-41e5-8e99-3a3a2a73afcd None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.924105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.943075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d1bed-bd98-41c0-96d4-5707569578f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.943725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1bed-bd98-41c0-96d4-5707569578f6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.944007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1bed-bd98-41c0-96d4-5707569578f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.944282 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1bed-bd98-41c0-96d4-5707569578f6 None admin] PATH_INFO: `/v3/users/d143b917c6c445769f91f1ac522c0326` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.959001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d1bed-bd98-41c0-96d4-5707569578f6 None admin] RBAC: Authorizing `identity:get_user(user_id=d143b917c6c445769f91f1ac522c0326)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:34.960577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d1bed-bd98-41c0-96d4-5707569578f6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:34.969686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 135/281] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/users/d143b917c6c445769f91f1ac522c0326 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:34.969686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d1bed-bd98-41c0-96d4-5707569578f6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.970011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 147/282] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:34.970176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35d6d9-56f6-4b20-ad07-d18ded139a80 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.093269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35d6d9-56f6-4b20-ad07-d18ded139a80 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.100283 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d1bed-bd98-41c0-96d4-5707569578f6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.114807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.137305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739dc697-3e1c-4d7d-a194-165c612260e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.137305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dc697-3e1c-4d7d-a194-165c612260e1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.137305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dc697-3e1c-4d7d-a194-165c612260e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.137599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739dc697-3e1c-4d7d-a194-165c612260e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.138534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739dc697-3e1c-4d7d-a194-165c612260e1 None admin] RBAC: Adding query filter params (role.id=8689bf0d70184aef9148c6b4a9758b32, user.id=d143b917c6c445769f91f1ac522c0326, scope.system=all) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.138852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739dc697-3e1c-4d7d-a194-165c612260e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.140393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edd816-2de4-4d81-9759-f0d2a261767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.140535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739dc697-3e1c-4d7d-a194-165c612260e1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.141034 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edd816-2de4-4d81-9759-f0d2a261767d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.141317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edd816-2de4-4d81-9759-f0d2a261767d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.141637 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edd816-2de4-4d81-9759-f0d2a261767d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.146325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 148/283] 10.222.0.88 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/role_assignments?user.id=d143b917c6c445769f91f1ac522c0326&scope.system=all&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.158319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edd816-2de4-4d81-9759-f0d2a261767d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f1edd816-2de4-4d81-9759-f0d2a261767d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:35.164579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.165568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:35.166354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 136/284] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:35.172092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739dc697-3e1c-4d7d-a194-165c612260e1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.279888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edd816-2de4-4d81-9759-f0d2a261767d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.287788 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739dc697-3e1c-4d7d-a194-165c612260e1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.334234 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.353001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81804b83-2522-4321-937e-c2b2142c060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.353617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804b83-2522-4321-937e-c2b2142c060b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.353894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804b83-2522-4321-937e-c2b2142c060b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.354161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804b83-2522-4321-937e-c2b2142c060b None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.354836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81804b83-2522-4321-937e-c2b2142c060b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.356929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81804b83-2522-4321-937e-c2b2142c060b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.358574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81804b83-2522-4321-937e-c2b2142c060b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.372268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 149/285] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.377512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81804b83-2522-4321-937e-c2b2142c060b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.439609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edd816-2de4-4d81-9759-f0d2a261767d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.455407 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.508359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f199-0fb9-4417-99e5-b266065151f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.508999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f199-0fb9-4417-99e5-b266065151f6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.509284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f199-0fb9-4417-99e5-b266065151f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.509542 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f199-0fb9-4417-99e5-b266065151f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.529444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01f199-0fb9-4417-99e5-b266065151f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-dd01f199-0fb9-4417-99e5-b266065151f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:35.534308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.535252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:35.536058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:35.542285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 137/286] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:35.542285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f199-0fb9-4417-99e5-b266065151f6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.583883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81804b83-2522-4321-937e-c2b2142c060b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.652972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.663286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f199-0fb9-4417-99e5-b266065151f6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.667139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047c0aa-6103-425b-a5cd-9aa12a4c21a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.668024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047c0aa-6103-425b-a5cd-9aa12a4c21a5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.670609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047c0aa-6103-425b-a5cd-9aa12a4c21a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.670609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047c0aa-6103-425b-a5cd-9aa12a4c21a5 None admin] PATH_INFO: `/v3/users/2b2d2fe451634e4da1d9bf38ce3d4379` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.671890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047c0aa-6103-425b-a5cd-9aa12a4c21a5 None admin] RBAC: Authorizing `identity:get_user(user_id=2b2d2fe451634e4da1d9bf38ce3d4379)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.678244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047c0aa-6103-425b-a5cd-9aa12a4c21a5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.679991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 150/287] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/users/2b2d2fe451634e4da1d9bf38ce3d4379 => generated 297 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:35.688936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047c0aa-6103-425b-a5cd-9aa12a4c21a5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.736393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bba73-66c3-4790-a6d8-957ce9f9b381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.737008 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bba73-66c3-4790-a6d8-957ce9f9b381 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.738216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bba73-66c3-4790-a6d8-957ce9f9b381 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.738216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bba73-66c3-4790-a6d8-957ce9f9b381 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.738384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bba73-66c3-4790-a6d8-957ce9f9b381 None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.738587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bba73-66c3-4790-a6d8-957ce9f9b381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.740256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bba73-66c3-4790-a6d8-957ce9f9b381 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.757316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 138/288] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.763397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bba73-66c3-4790-a6d8-957ce9f9b381 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.921498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047c0aa-6103-425b-a5cd-9aa12a4c21a5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.924902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bba73-66c3-4790-a6d8-957ce9f9b381 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.939188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.989797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c718-9a9b-4e98-9199-f35a25abd7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.990410 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c718-9a9b-4e98-9199-f35a25abd7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.990700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c718-9a9b-4e98-9199-f35a25abd7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.990980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c718-9a9b-4e98-9199-f35a25abd7d4 None admin] PATH_INFO: `/v3/users/e48593011a694e49a3466654813957b7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.992174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466c718-9a9b-4e98-9199-f35a25abd7d4 None admin] RBAC: Authorizing `identity:get_user(user_id=e48593011a694e49a3466654813957b7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.993642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466c718-9a9b-4e98-9199-f35a25abd7d4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.995576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 139/289] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/users/e48593011a694e49a3466654813957b7 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.998598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f26fd3-7547-40e7-b57f-ca07f268f663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.999278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26fd3-7547-40e7-b57f-ca07f268f663 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.999560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26fd3-7547-40e7-b57f-ca07f268f663 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.999830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26fd3-7547-40e7-b57f-ca07f268f663 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.003565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f26fd3-7547-40e7-b57f-ca07f268f663 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.005045 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f26fd3-7547-40e7-b57f-ca07f268f663 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.007682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 151/290] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:36.009436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c718-9a9b-4e98-9199-f35a25abd7d4 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.012399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f26fd3-7547-40e7-b57f-ca07f268f663 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.063402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.164987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f26fd3-7547-40e7-b57f-ca07f268f663 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.204300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702910d5-0a2b-413a-a1c9-8bf13f75b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.205002 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702910d5-0a2b-413a-a1c9-8bf13f75b023 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.205285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702910d5-0a2b-413a-a1c9-8bf13f75b023 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.205560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702910d5-0a2b-413a-a1c9-8bf13f75b023 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/users/2b2d2fe451634e4da1d9bf38ce3d4379/roles/699bd71b35c444f6b0f64e4e2b14b682` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.207552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702910d5-0a2b-413a-a1c9-8bf13f75b023 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce37eeb36b8d44b0ae5c523d52045e8b, user_id=2b2d2fe451634e4da1d9bf38ce3d4379, role_id=699bd71b35c444f6b0f64e4e2b14b682)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.208228 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c718-9a9b-4e98-9199-f35a25abd7d4 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.209012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702910d5-0a2b-413a-a1c9-8bf13f75b023 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.256964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694de1c-26d7-43d5-a9b4-9efb2f937b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.257513 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694de1c-26d7-43d5-a9b4-9efb2f937b40 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.257795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694de1c-26d7-43d5-a9b4-9efb2f937b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.258074 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694de1c-26d7-43d5-a9b4-9efb2f937b40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.288552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 152/291] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:36 2022] PUT /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/users/2b2d2fe451634e4da1d9bf38ce3d4379/roles/699bd71b35c444f6b0f64e4e2b14b682 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:36.342924 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694de1c-26d7-43d5-a9b4-9efb2f937b40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.344549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694de1c-26d7-43d5-a9b4-9efb2f937b40 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.388658 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.497769 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 140/292] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:36.503263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702910d5-0a2b-413a-a1c9-8bf13f75b023 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.563701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.620784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702910d5-0a2b-413a-a1c9-8bf13f75b023 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.660479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad844cb7-b301-4e2d-9c04-9f0d238ddc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.661020 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad844cb7-b301-4e2d-9c04-9f0d238ddc45 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.661306 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad844cb7-b301-4e2d-9c04-9f0d238ddc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.661582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad844cb7-b301-4e2d-9c04-9f0d238ddc45 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.664700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad844cb7-b301-4e2d-9c04-9f0d238ddc45 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.669505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad844cb7-b301-4e2d-9c04-9f0d238ddc45 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.670584 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 153/293] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:36.681013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694de1c-26d7-43d5-a9b4-9efb2f937b40 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.814399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694de1c-26d7-43d5-a9b4-9efb2f937b40 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.847277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.857117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a613738-585c-49fd-b056-bc32a2f9482f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.857726 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613738-585c-49fd-b056-bc32a2f9482f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.858249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613738-585c-49fd-b056-bc32a2f9482f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.858526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a613738-585c-49fd-b056-bc32a2f9482f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.859307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a613738-585c-49fd-b056-bc32a2f9482f None admin] RBAC: Adding query filter params (role.id=8689bf0d70184aef9148c6b4a9758b32, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b, user.id=e48593011a694e49a3466654813957b7) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:36.859614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a613738-585c-49fd-b056-bc32a2f9482f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.861062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a613738-585c-49fd-b056-bc32a2f9482f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.869296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 141/294] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/role_assignments?user.id=e48593011a694e49a3466654813957b7&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:37.157748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bfdd-3b5f-43ba-8e01-dc08c3110e20 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.158104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bfdd-3b5f-43ba-8e01-dc08c3110e20 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.158216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bfdd-3b5f-43ba-8e01-dc08c3110e20 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.160080 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 154/295] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:37.165455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3aa72-3f3e-47fb-adb9-ca8ebc1fa8d6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.165969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3aa72-3f3e-47fb-adb9-ca8ebc1fa8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.166461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3aa72-3f3e-47fb-adb9-ca8ebc1fa8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.187882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-79e3aa72-3f3e-47fb-adb9-ca8ebc1fa8d6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:37.189423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-79e3aa72-3f3e-47fb-adb9-ca8ebc1fa8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:37.260050 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 142/296] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:37.393173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09236f8-688d-4758-aaa3-77d2d0a73f92 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.393667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09236f8-688d-4758-aaa3-77d2d0a73f92 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.393758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09236f8-688d-4758-aaa3-77d2d0a73f92 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.395509 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 155/297] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:37.400491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955da299-60ac-41fa-8540-3912f7c73080 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.401025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955da299-60ac-41fa-8540-3912f7c73080 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.401497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955da299-60ac-41fa-8540-3912f7c73080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.423758 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-955da299-60ac-41fa-8540-3912f7c73080 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:37.425278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-955da299-60ac-41fa-8540-3912f7c73080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:37.478774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c7155-d57e-4f60-b07d-3df42143f6c9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.479114 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c7155-d57e-4f60-b07d-3df42143f6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.479313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c7155-d57e-4f60-b07d-3df42143f6c9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.480710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 156/298] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:37.486430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22346-ea8f-4c77-b5b0-072d4278744b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.486715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22346-ea8f-4c77-b5b0-072d4278744b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.487040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22346-ea8f-4c77-b5b0-072d4278744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.510094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 143/299] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:37.516172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-92e22346-ea8f-4c77-b5b0-072d4278744b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:37.517620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-92e22346-ea8f-4c77-b5b0-072d4278744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:37.574128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955da299-60ac-41fa-8540-3912f7c73080 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.592683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 157/300] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:37.643466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.683553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955da299-60ac-41fa-8540-3912f7c73080 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.718943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b9c29-4f9f-4452-9150-f26c88fd9680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.719638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b9c29-4f9f-4452-9150-f26c88fd9680 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.719921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b9c29-4f9f-4452-9150-f26c88fd9680 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.720195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b9c29-4f9f-4452-9150-f26c88fd9680 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.730746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b9c29-4f9f-4452-9150-f26c88fd9680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-6e5b9c29-4f9f-4452-9150-f26c88fd9680 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:37.736425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:37.737325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:37.738123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 144/301] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:37.743513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e22346-ea8f-4c77-b5b0-072d4278744b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.783735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.793878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b9c29-4f9f-4452-9150-f26c88fd9680 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.856365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e22346-ea8f-4c77-b5b0-072d4278744b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.892638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac40b3-9a6a-47f3-8651-f09232e31e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.893257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac40b3-9a6a-47f3-8651-f09232e31e65 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.893543 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac40b3-9a6a-47f3-8651-f09232e31e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.893820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac40b3-9a6a-47f3-8651-f09232e31e65 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.894485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac40b3-9a6a-47f3-8651-f09232e31e65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:37.894793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac40b3-9a6a-47f3-8651-f09232e31e65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.896209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac40b3-9a6a-47f3-8651-f09232e31e65 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.904366 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 158/302] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:37.907908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac40b3-9a6a-47f3-8651-f09232e31e65 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.914981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b9c29-4f9f-4452-9150-f26c88fd9680 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.927001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.950864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d796222-2b3b-4b4e-8aa0-9088aad75bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.951600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d796222-2b3b-4b4e-8aa0-9088aad75bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.951782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d796222-2b3b-4b4e-8aa0-9088aad75bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.952022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d796222-2b3b-4b4e-8aa0-9088aad75bc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.965205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d796222-2b3b-4b4e-8aa0-9088aad75bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-1d796222-2b3b-4b4e-8aa0-9088aad75bc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:37.970514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:37.971480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:37.972271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 145/303] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:37.972957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d796222-2b3b-4b4e-8aa0-9088aad75bc1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.014881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.022983 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac40b3-9a6a-47f3-8651-f09232e31e65 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.058604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3e5a1-bd82-4a48-adba-dcef9d7cc51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.059321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3e5a1-bd82-4a48-adba-dcef9d7cc51d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.059604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3e5a1-bd82-4a48-adba-dcef9d7cc51d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.059880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3e5a1-bd82-4a48-adba-dcef9d7cc51d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.062362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3e5a1-bd82-4a48-adba-dcef9d7cc51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.063879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3e5a1-bd82-4a48-adba-dcef9d7cc51d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.065524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 159/304] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.067661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3e5a1-bd82-4a48-adba-dcef9d7cc51d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.089365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d796222-2b3b-4b4e-8aa0-9088aad75bc1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.126435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b01792-0b10-4be4-b9b2-955d027d03dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.127236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b01792-0b10-4be4-b9b2-955d027d03dc None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.127527 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b01792-0b10-4be4-b9b2-955d027d03dc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.127806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b01792-0b10-4be4-b9b2-955d027d03dc None admin] PATH_INFO: `/v3/users/883d73b5290d449f902f1c517df80af0` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.142524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b01792-0b10-4be4-b9b2-955d027d03dc None admin] RBAC: Authorizing `identity:get_user(user_id=883d73b5290d449f902f1c517df80af0)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.144044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b01792-0b10-4be4-b9b2-955d027d03dc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.145723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 146/305] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/users/883d73b5290d449f902f1c517df80af0 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.146489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b01792-0b10-4be4-b9b2-955d027d03dc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.179246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.180663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3e5a1-bd82-4a48-adba-dcef9d7cc51d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.216449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3afd3e-36ab-45db-ba36-3a6c8b3d99d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.217059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3afd3e-36ab-45db-ba36-3a6c8b3d99d4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.217335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3afd3e-36ab-45db-ba36-3a6c8b3d99d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.217604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3afd3e-36ab-45db-ba36-3a6c8b3d99d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.218268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3afd3e-36ab-45db-ba36-3a6c8b3d99d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.218566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3afd3e-36ab-45db-ba36-3a6c8b3d99d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.219979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3afd3e-36ab-45db-ba36-3a6c8b3d99d4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.234190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 160/306] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.234987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3afd3e-36ab-45db-ba36-3a6c8b3d99d4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.258691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b01792-0b10-4be4-b9b2-955d027d03dc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.262901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.298926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd9822-9e8a-4fd6-8238-29c9ac6d55c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.299575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd9822-9e8a-4fd6-8238-29c9ac6d55c2 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.299858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd9822-9e8a-4fd6-8238-29c9ac6d55c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.300132 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd9822-9e8a-4fd6-8238-29c9ac6d55c2 None admin] PATH_INFO: `/v3/groups` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.300768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd9822-9e8a-4fd6-8238-29c9ac6d55c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.302218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd9822-9e8a-4fd6-8238-29c9ac6d55c2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.341156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3afd3e-36ab-45db-ba36-3a6c8b3d99d4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.376710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680091a5-5d4e-44a5-8114-5e5e25daccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.377580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680091a5-5d4e-44a5-8114-5e5e25daccf2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.377580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680091a5-5d4e-44a5-8114-5e5e25daccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.377840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680091a5-5d4e-44a5-8114-5e5e25daccf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.378577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680091a5-5d4e-44a5-8114-5e5e25daccf2 None admin] RBAC: Adding query filter params (role.id=699bd71b35c444f6b0f64e4e2b14b682, user.id=883d73b5290d449f902f1c517df80af0, scope.system=all) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.378889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680091a5-5d4e-44a5-8114-5e5e25daccf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.382556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680091a5-5d4e-44a5-8114-5e5e25daccf2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.388081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 161/307] 10.222.0.88 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/role_assignments?user.id=883d73b5290d449f902f1c517df80af0&scope.system=all&role.id=699bd71b35c444f6b0f64e4e2b14b682 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.388910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680091a5-5d4e-44a5-8114-5e5e25daccf2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.414175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 147/308] 10.222.0.88 () {60 vars in 1134 bytes} [Wed Aug 24 03:26:38 2022] POST /identity/v3/groups => generated 229 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:38.519988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.541343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680091a5-5d4e-44a5-8114-5e5e25daccf2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.583454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f084b8-beb0-40bc-92d9-bc3cb8191a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.584097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f084b8-beb0-40bc-92d9-bc3cb8191a0f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.584373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f084b8-beb0-40bc-92d9-bc3cb8191a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.584645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f084b8-beb0-40bc-92d9-bc3cb8191a0f None admin] PATH_INFO: `/v3/users/d143b917c6c445769f91f1ac522c0326` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.585823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f084b8-beb0-40bc-92d9-bc3cb8191a0f None admin] RBAC: Authorizing `identity:get_user(user_id=d143b917c6c445769f91f1ac522c0326)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.587293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f084b8-beb0-40bc-92d9-bc3cb8191a0f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.589039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 162/309] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/users/d143b917c6c445769f91f1ac522c0326 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.595284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd9822-9e8a-4fd6-8238-29c9ac6d55c2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.609556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604c543-cc90-4bf6-af6b-f192a8d12724 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.609872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604c543-cc90-4bf6-af6b-f192a8d12724 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.610107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604c543-cc90-4bf6-af6b-f192a8d12724 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.611511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 163/310] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:38.616677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de751ff7-0b69-40b7-865c-febfcc9fa80c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.616948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de751ff7-0b69-40b7-865c-febfcc9fa80c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.617221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de751ff7-0b69-40b7-865c-febfcc9fa80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.635398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-de751ff7-0b69-40b7-865c-febfcc9fa80c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:38.636586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de751ff7-0b69-40b7-865c-febfcc9fa80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:38.707396 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.717707 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 164/311] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:38.724246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd9822-9e8a-4fd6-8238-29c9ac6d55c2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.771552 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4939a-dd91-435d-bfb1-52b3ff68a705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.772576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4939a-dd91-435d-bfb1-52b3ff68a705 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.773049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4939a-dd91-435d-bfb1-52b3ff68a705 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.774599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4939a-dd91-435d-bfb1-52b3ff68a705 None admin] PATH_INFO: `/v3/system/users/d143b917c6c445769f91f1ac522c0326/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.776403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4939a-dd91-435d-bfb1-52b3ff68a705 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d143b917c6c445769f91f1ac522c0326, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.779161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4939a-dd91-435d-bfb1-52b3ff68a705 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.877347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 148/312] 10.222.0.88 () {58 vars in 1334 bytes} [Wed Aug 24 03:26:38 2022] PUT /identity/v3/system/users/d143b917c6c445769f91f1ac522c0326/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:39.007830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de751ff7-0b69-40b7-865c-febfcc9fa80c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.110344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.127321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de751ff7-0b69-40b7-865c-febfcc9fa80c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.162559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fa1a0-4bac-4aa0-a16c-264b885039e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.163237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fa1a0-4bac-4aa0-a16c-264b885039e5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.163526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fa1a0-4bac-4aa0-a16c-264b885039e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.163804 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fa1a0-4bac-4aa0-a16c-264b885039e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.174629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fa1a0-4bac-4aa0-a16c-264b885039e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-2e7fa1a0-4bac-4aa0-a16c-264b885039e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:39.179551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:39.180440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:39.181240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:39.185968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 165/313] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:39.187340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4939a-dd91-435d-bfb1-52b3ff68a705 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.290893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4939a-dd91-435d-bfb1-52b3ff68a705 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.327283 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784469-b9a1-4dbc-b3f5-43b908515df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.327895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784469-b9a1-4dbc-b3f5-43b908515df0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.328174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784469-b9a1-4dbc-b3f5-43b908515df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.328443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784469-b9a1-4dbc-b3f5-43b908515df0 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.329108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74784469-b9a1-4dbc-b3f5-43b908515df0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:39.329408 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74784469-b9a1-4dbc-b3f5-43b908515df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.330790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74784469-b9a1-4dbc-b3f5-43b908515df0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.339734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 149/314] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:39.348448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fa1a0-4bac-4aa0-a16c-264b885039e5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.459347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fa1a0-4bac-4aa0-a16c-264b885039e5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.494194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8afc06-4a5a-45e9-8adc-13192ee734c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.494827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8afc06-4a5a-45e9-8adc-13192ee734c4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.495126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8afc06-4a5a-45e9-8adc-13192ee734c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.495400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8afc06-4a5a-45e9-8adc-13192ee734c4 None admin] PATH_INFO: `/v3/users/2b2d2fe451634e4da1d9bf38ce3d4379` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.496598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8afc06-4a5a-45e9-8adc-13192ee734c4 None admin] RBAC: Authorizing `identity:get_user(user_id=2b2d2fe451634e4da1d9bf38ce3d4379)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.498059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8afc06-4a5a-45e9-8adc-13192ee734c4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.499995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 166/315] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/users/2b2d2fe451634e4da1d9bf38ce3d4379 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:39.508305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784469-b9a1-4dbc-b3f5-43b908515df0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.529321 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.621273 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784469-b9a1-4dbc-b3f5-43b908515df0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.656752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22b5a2-91c1-409b-8e40-18f858b727c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.657367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22b5a2-91c1-409b-8e40-18f858b727c0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.657694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22b5a2-91c1-409b-8e40-18f858b727c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.657967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22b5a2-91c1-409b-8e40-18f858b727c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.728977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22b5a2-91c1-409b-8e40-18f858b727c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.730368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22b5a2-91c1-409b-8e40-18f858b727c0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.745253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.841720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 150/316] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:39.850252 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8afc06-4a5a-45e9-8adc-13192ee734c4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.871805 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.962520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8afc06-4a5a-45e9-8adc-13192ee734c4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:40.000596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cdc98-335a-4a8a-a20f-c5442a4e76f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:40.001567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cdc98-335a-4a8a-a20f-c5442a4e76f6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.002074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cdc98-335a-4a8a-a20f-c5442a4e76f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.002547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cdc98-335a-4a8a-a20f-c5442a4e76f6 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.004020 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cdc98-335a-4a8a-a20f-c5442a4e76f6 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:40.005861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cdc98-335a-4a8a-a20f-c5442a4e76f6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:40.013382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 167/317] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:40.015002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22b5a2-91c1-409b-8e40-18f858b727c0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:40.128311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22b5a2-91c1-409b-8e40-18f858b727c0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:40.144297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:40.165260 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70755e79-c418-46bb-be63-9bd1d88cb650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:40.165879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755e79-c418-46bb-be63-9bd1d88cb650 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.166165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755e79-c418-46bb-be63-9bd1d88cb650 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.166442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755e79-c418-46bb-be63-9bd1d88cb650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.167221 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70755e79-c418-46bb-be63-9bd1d88cb650 None admin] RBAC: Adding query filter params (role.id=699bd71b35c444f6b0f64e4e2b14b682, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b, user.id=2b2d2fe451634e4da1d9bf38ce3d4379) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:40.167537 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70755e79-c418-46bb-be63-9bd1d88cb650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:40.169523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70755e79-c418-46bb-be63-9bd1d88cb650 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:40.180384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 151/318] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:40 2022] GET /identity/v3/role_assignments?user.id=2b2d2fe451634e4da1d9bf38ce3d4379&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=699bd71b35c444f6b0f64e4e2b14b682 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:40.392173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220cc9e-13d4-4a06-9337-d5dae0adc3b2 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.392501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220cc9e-13d4-4a06-9337-d5dae0adc3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.392651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220cc9e-13d4-4a06-9337-d5dae0adc3b2 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.394271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 168/319] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:40.399601 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e98663-5d9e-4830-9eac-14f102ba9f23 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.399931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e98663-5d9e-4830-9eac-14f102ba9f23 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.400238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e98663-5d9e-4830-9eac-14f102ba9f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.420376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-50e98663-5d9e-4830-9eac-14f102ba9f23 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:40.421590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-50e98663-5d9e-4830-9eac-14f102ba9f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:40.493808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 152/320] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:40.601776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e587778-567c-4d3e-b184-fdd759a867dd None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.602087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e587778-567c-4d3e-b184-fdd759a867dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.602342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e587778-567c-4d3e-b184-fdd759a867dd None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.603878 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 169/321] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:40.610073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9d322-6765-401a-b1cc-e8d158fc5483 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.610370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9d322-6765-401a-b1cc-e8d158fc5483 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.610651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9d322-6765-401a-b1cc-e8d158fc5483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.629016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bdc9d322-6765-401a-b1cc-e8d158fc5483 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:40.630212 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bdc9d322-6765-401a-b1cc-e8d158fc5483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:40.697065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 153/322] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:40.767026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e587778-567c-4d3e-b184-fdd759a867dd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:40.854898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:40.876847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e587778-567c-4d3e-b184-fdd759a867dd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:40.913890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bc554-6b37-4db2-82fb-e7c4487c507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:40.914526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bc554-6b37-4db2-82fb-e7c4487c507f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.914808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bc554-6b37-4db2-82fb-e7c4487c507f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.915115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bc554-6b37-4db2-82fb-e7c4487c507f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.926480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141e69b-ff94-49d0-9548-29320e1bf5cd None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.926943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141e69b-ff94-49d0-9548-29320e1bf5cd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.927040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141e69b-ff94-49d0-9548-29320e1bf5cd None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.927273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bc554-6b37-4db2-82fb-e7c4487c507f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:40.928521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 154/323] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b33bc554-6b37-4db2-82fb-e7c4487c507f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:40.932095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:40.932993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:40.934507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 170/324] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:40.936463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298bf40-c7c0-43d5-b41d-056adde266bd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.936752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298bf40-c7c0-43d5-b41d-056adde266bd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.937027 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298bf40-c7c0-43d5-b41d-056adde266bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.938701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bc554-6b37-4db2-82fb-e7c4487c507f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:40.955730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f298bf40-c7c0-43d5-b41d-056adde266bd None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:40.957091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f298bf40-c7c0-43d5-b41d-056adde266bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:40.989176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.026374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 155/325] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:41.027500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298bf40-c7c0-43d5-b41d-056adde266bd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.044945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bc554-6b37-4db2-82fb-e7c4487c507f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.082480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178d2f9-b1bd-4d5c-b621-0c39b644ef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.083107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178d2f9-b1bd-4d5c-b621-0c39b644ef7d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.083385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178d2f9-b1bd-4d5c-b621-0c39b644ef7d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.083652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178d2f9-b1bd-4d5c-b621-0c39b644ef7d None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.084319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178d2f9-b1bd-4d5c-b621-0c39b644ef7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:41.084620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178d2f9-b1bd-4d5c-b621-0c39b644ef7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.086036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178d2f9-b1bd-4d5c-b621-0c39b644ef7d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.095264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 171/326] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:41.100895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178d2f9-b1bd-4d5c-b621-0c39b644ef7d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.107114 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.136508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298bf40-c7c0-43d5-b41d-056adde266bd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.171354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b03acc-7df9-4b21-946f-ae904ada8a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.171992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03acc-7df9-4b21-946f-ae904ada8a9f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.172275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03acc-7df9-4b21-946f-ae904ada8a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.172554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03acc-7df9-4b21-946f-ae904ada8a9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.173665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b03acc-7df9-4b21-946f-ae904ada8a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.175154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b03acc-7df9-4b21-946f-ae904ada8a9f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.176722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 156/327] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:41.182012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b03acc-7df9-4b21-946f-ae904ada8a9f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.213830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178d2f9-b1bd-4d5c-b621-0c39b644ef7d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.216669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.249875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d9a2-08bf-4f05-b3bd-480534c4bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.250729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d9a2-08bf-4f05-b3bd-480534c4bcce None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.251197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d9a2-08bf-4f05-b3bd-480534c4bcce None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.251614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d9a2-08bf-4f05-b3bd-480534c4bcce None admin] PATH_INFO: `/v3/users/883d73b5290d449f902f1c517df80af0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.252935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80d9a2-08bf-4f05-b3bd-480534c4bcce None admin] RBAC: Authorizing `identity:get_user(user_id=883d73b5290d449f902f1c517df80af0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.254566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80d9a2-08bf-4f05-b3bd-480534c4bcce None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.256633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 172/328] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/users/883d73b5290d449f902f1c517df80af0 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:41.263005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d9a2-08bf-4f05-b3bd-480534c4bcce None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.284698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b03acc-7df9-4b21-946f-ae904ada8a9f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.321054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7cf9-9228-4087-9c96-dfbcc3eb22be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.321662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7cf9-9228-4087-9c96-dfbcc3eb22be None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.321946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7cf9-9228-4087-9c96-dfbcc3eb22be None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.322224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7cf9-9228-4087-9c96-dfbcc3eb22be None admin] PATH_INFO: `/v3/groups` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.322880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c7cf9-9228-4087-9c96-dfbcc3eb22be None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.324904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c7cf9-9228-4087-9c96-dfbcc3eb22be None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.340405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.369339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d9a2-08bf-4f05-b3bd-480534c4bcce None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.402731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857bfa4-66ae-4eef-a0cd-3992c9ad94ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.403453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857bfa4-66ae-4eef-a0cd-3992c9ad94ba None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.403739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857bfa4-66ae-4eef-a0cd-3992c9ad94ba None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.404017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857bfa4-66ae-4eef-a0cd-3992c9ad94ba None admin] PATH_INFO: `/v3/system/users/883d73b5290d449f902f1c517df80af0/roles/699bd71b35c444f6b0f64e4e2b14b682` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.405535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857bfa4-66ae-4eef-a0cd-3992c9ad94ba None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=883d73b5290d449f902f1c517df80af0, role_id=699bd71b35c444f6b0f64e4e2b14b682)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.407107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857bfa4-66ae-4eef-a0cd-3992c9ad94ba None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.407466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 157/329] 10.222.0.88 () {60 vars in 1134 bytes} [Wed Aug 24 03:26:41 2022] POST /identity/v3/groups => generated 226 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:26:41.414644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7cf9-9228-4087-9c96-dfbcc3eb22be None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.476702 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 173/330] 10.222.0.88 () {58 vars in 1334 bytes} [Wed Aug 24 03:26:41 2022] PUT /identity/v3/system/users/883d73b5290d449f902f1c517df80af0/roles/699bd71b35c444f6b0f64e4e2b14b682 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:41.547315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.554539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7cf9-9228-4087-9c96-dfbcc3eb22be None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.597460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19228b-6db7-48ef-9fd2-edb47351d2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.598229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19228b-6db7-48ef-9fd2-edb47351d2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.598506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19228b-6db7-48ef-9fd2-edb47351d2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.598791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19228b-6db7-48ef-9fd2-edb47351d2f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.611743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19228b-6db7-48ef-9fd2-edb47351d2f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-9e19228b-6db7-48ef-9fd2-edb47351d2f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:41.616912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:41.617841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:41.618641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 158/331] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:41.624710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857bfa4-66ae-4eef-a0cd-3992c9ad94ba None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.734088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857bfa4-66ae-4eef-a0cd-3992c9ad94ba None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.774030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fe44f-fe5b-4b0a-94ae-35556dc06e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.774661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe44f-fe5b-4b0a-94ae-35556dc06e7c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.774944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe44f-fe5b-4b0a-94ae-35556dc06e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.775265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe44f-fe5b-4b0a-94ae-35556dc06e7c None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.775947 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fe44f-fe5b-4b0a-94ae-35556dc06e7c None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:41.776251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fe44f-fe5b-4b0a-94ae-35556dc06e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.777691 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fe44f-fe5b-4b0a-94ae-35556dc06e7c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.780403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.790294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 174/332] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:41.794916 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19228b-6db7-48ef-9fd2-edb47351d2f5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.928747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19228b-6db7-48ef-9fd2-edb47351d2f5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.971835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a1108-2b39-4b3e-99b5-ceea52b9a0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.972493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a1108-2b39-4b3e-99b5-ceea52b9a0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.972778 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a1108-2b39-4b3e-99b5-ceea52b9a0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.973056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a1108-2b39-4b3e-99b5-ceea52b9a0c4 None admin] PATH_INFO: `/v3/users/d143b917c6c445769f91f1ac522c0326` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.974811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a1108-2b39-4b3e-99b5-ceea52b9a0c4 None admin] RBAC: Authorizing `identity:get_user(user_id=d143b917c6c445769f91f1ac522c0326)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.976315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a1108-2b39-4b3e-99b5-ceea52b9a0c4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.978301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 159/333] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/users/d143b917c6c445769f91f1ac522c0326 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:41.984944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fe44f-fe5b-4b0a-94ae-35556dc06e7c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.113629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fe44f-fe5b-4b0a-94ae-35556dc06e7c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.155019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa10da-20fe-4477-b051-13779f7c3f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.155690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa10da-20fe-4477-b051-13779f7c3f48 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.155977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa10da-20fe-4477-b051-13779f7c3f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.156250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa10da-20fe-4477-b051-13779f7c3f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.156981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa10da-20fe-4477-b051-13779f7c3f48 None admin] RBAC: Adding query filter params (role.id=8689bf0d70184aef9148c6b4a9758b32, user.id=d143b917c6c445769f91f1ac522c0326, scope.system=all) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:42.157287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa10da-20fe-4477-b051-13779f7c3f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.158747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa10da-20fe-4477-b051-13779f7c3f48 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.172143 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 175/334] 10.222.0.88 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/role_assignments?user.id=d143b917c6c445769f91f1ac522c0326&scope.system=all&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.548687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1bea-1d5e-4fa2-bca5-653b31d775ec None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.549199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1bea-1d5e-4fa2-bca5-653b31d775ec None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.549272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1bea-1d5e-4fa2-bca5-653b31d775ec None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.550835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 160/335] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:43.556544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e89ce-dacc-49b0-93bf-0dc2ec093a1b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.556982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e89ce-dacc-49b0-93bf-0dc2ec093a1b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.557297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e89ce-dacc-49b0-93bf-0dc2ec093a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.581933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9c5e89ce-dacc-49b0-93bf-0dc2ec093a1b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:43.582898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18b416-d898-4c9d-b325-087c6e349a0b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.583200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c5e89ce-dacc-49b0-93bf-0dc2ec093a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:43.583304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18b416-d898-4c9d-b325-087c6e349a0b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.583476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18b416-d898-4c9d-b325-087c6e349a0b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.585055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 161/336] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:43.590771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a144-67f3-4ae9-a917-9fe5c4c59ce3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.591068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a144-67f3-4ae9-a917-9fe5c4c59ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.591357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a144-67f3-4ae9-a917-9fe5c4c59ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.614768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-21d5a144-67f3-4ae9-a917-9fe5c4c59ce3 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:43.616488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-21d5a144-67f3-4ae9-a917-9fe5c4c59ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:43.647020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.654766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.697671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 176/337] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:43.709815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 162/338] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:44.044967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e89ce-dacc-49b0-93bf-0dc2ec093a1b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.143105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67539320-7993-4005-a67a-93a7d680ab3e None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.143298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67539320-7993-4005-a67a-93a7d680ab3e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.143583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67539320-7993-4005-a67a-93a7d680ab3e None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.145218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 163/339] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:44.150614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078f088-9925-44e6-8fdb-50a17e0ff307 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.150893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078f088-9925-44e6-8fdb-50a17e0ff307 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.151222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078f088-9925-44e6-8fdb-50a17e0ff307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.157205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e89ce-dacc-49b0-93bf-0dc2ec093a1b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.192281 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a078f088-9925-44e6-8fdb-50a17e0ff307 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:44.193312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a078f088-9925-44e6-8fdb-50a17e0ff307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:44.201683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4943cd-0abe-496b-9427-a189f6b9714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.202627 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4943cd-0abe-496b-9427-a189f6b9714c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.203135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4943cd-0abe-496b-9427-a189f6b9714c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.203668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4943cd-0abe-496b-9427-a189f6b9714c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.224648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4943cd-0abe-496b-9427-a189f6b9714c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1f4943cd-0abe-496b-9427-a189f6b9714c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:44.230226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:44.231210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:44.232022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:44.234876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 177/340] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:44.239962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4943cd-0abe-496b-9427-a189f6b9714c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.293994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.311385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 164/341] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:44.312520 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078f088-9925-44e6-8fdb-50a17e0ff307 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.355566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4943cd-0abe-496b-9427-a189f6b9714c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.393699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406400-25b3-44bf-9123-8ea4d3d6af29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.394672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406400-25b3-44bf-9123-8ea4d3d6af29 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.395189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406400-25b3-44bf-9123-8ea4d3d6af29 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.395666 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406400-25b3-44bf-9123-8ea4d3d6af29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.407184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406400-25b3-44bf-9123-8ea4d3d6af29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-fa406400-25b3-44bf-9123-8ea4d3d6af29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:44.412308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:44.413209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:44.414007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:44.416631 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 178/342] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:44.422587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406400-25b3-44bf-9123-8ea4d3d6af29 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.478063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.508416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078f088-9925-44e6-8fdb-50a17e0ff307 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.560687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288e382-bd9f-4b3d-a073-d4f3e517b1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.561308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288e382-bd9f-4b3d-a073-d4f3e517b1ca None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.561577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288e382-bd9f-4b3d-a073-d4f3e517b1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.561856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288e382-bd9f-4b3d-a073-d4f3e517b1ca None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.562555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288e382-bd9f-4b3d-a073-d4f3e517b1ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.563012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288e382-bd9f-4b3d-a073-d4f3e517b1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.564251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288e382-bd9f-4b3d-a073-d4f3e517b1ca None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.572632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406400-25b3-44bf-9123-8ea4d3d6af29 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.579905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 165/343] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.588261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.604486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288e382-bd9f-4b3d-a073-d4f3e517b1ca None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.625645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae332b1-5079-455c-a476-9da7c653ee00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.626783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae332b1-5079-455c-a476-9da7c653ee00 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.627297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae332b1-5079-455c-a476-9da7c653ee00 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.627750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae332b1-5079-455c-a476-9da7c653ee00 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.628657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae332b1-5079-455c-a476-9da7c653ee00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.629140 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae332b1-5079-455c-a476-9da7c653ee00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.630715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae332b1-5079-455c-a476-9da7c653ee00 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.640515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 179/344] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.646120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae332b1-5079-455c-a476-9da7c653ee00 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.755082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae332b1-5079-455c-a476-9da7c653ee00 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.792519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144b951-f344-4c4a-b375-fba1b8d36623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.792748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288e382-bd9f-4b3d-a073-d4f3e517b1ca None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.793677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144b951-f344-4c4a-b375-fba1b8d36623 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.794162 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144b951-f344-4c4a-b375-fba1b8d36623 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.794635 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144b951-f344-4c4a-b375-fba1b8d36623 None admin] PATH_INFO: `/v3/users/883d73b5290d449f902f1c517df80af0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.799829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144b951-f344-4c4a-b375-fba1b8d36623 None admin] RBAC: Authorizing `identity:get_user(user_id=883d73b5290d449f902f1c517df80af0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.801568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144b951-f344-4c4a-b375-fba1b8d36623 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.803796 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 180/345] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/users/883d73b5290d449f902f1c517df80af0 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.805385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71f3b0-860f-4f2a-a61a-2b3ff9350531 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.805871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71f3b0-860f-4f2a-a61a-2b3ff9350531 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.806345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71f3b0-860f-4f2a-a61a-2b3ff9350531 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.808100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 181/346] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:44.809075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71f3b0-860f-4f2a-a61a-2b3ff9350531 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.851706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897db65-2da5-4745-83e4-f35c1321a05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.853147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897db65-2da5-4745-83e4-f35c1321a05b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.854729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897db65-2da5-4745-83e4-f35c1321a05b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.855602 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897db65-2da5-4745-83e4-f35c1321a05b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.856437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.876716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.944809 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71f3b0-860f-4f2a-a61a-2b3ff9350531 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.956765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897db65-2da5-4745-83e4-f35c1321a05b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.958566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897db65-2da5-4745-83e4-f35c1321a05b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.989266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8e84e-40cc-4c2f-bb78-bfe7ccf9c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.989909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8e84e-40cc-4c2f-bb78-bfe7ccf9c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.990183 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8e84e-40cc-4c2f-bb78-bfe7ccf9c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.990456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8e84e-40cc-4c2f-bb78-bfe7ccf9c5e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.001546 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8e84e-40cc-4c2f-bb78-bfe7ccf9c5e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-bdc8e84e-40cc-4c2f-bb78-bfe7ccf9c5e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:45.007192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:45.008177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 182/347] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:45.009611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f81a7-688e-425f-9858-fdd6ca0a967f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.010361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f81a7-688e-425f-9858-fdd6ca0a967f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.010361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f81a7-688e-425f-9858-fdd6ca0a967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.032745 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7a9f81a7-688e-425f-9858-fdd6ca0a967f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:45.033246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7a9f81a7-688e-425f-9858-fdd6ca0a967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:45.159526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 166/348] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:45.160410 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897db65-2da5-4745-83e4-f35c1321a05b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.206795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 183/349] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:45.210027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f81a7-688e-425f-9858-fdd6ca0a967f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.235269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.265891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.342380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897db65-2da5-4745-83e4-f35c1321a05b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.365118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f81a7-688e-425f-9858-fdd6ca0a967f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.397292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc17d7-2d2c-4cb6-87a0-91c17c22cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.398449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc17d7-2d2c-4cb6-87a0-91c17c22cf48 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.399110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc17d7-2d2c-4cb6-87a0-91c17c22cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.399648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc17d7-2d2c-4cb6-87a0-91c17c22cf48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.400743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc17d7-2d2c-4cb6-87a0-91c17c22cf48 None admin] RBAC: Adding query filter params (role.id=699bd71b35c444f6b0f64e4e2b14b682, user.id=883d73b5290d449f902f1c517df80af0, scope.system=all) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.400850 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cccbc3-0223-48ad-bf6c-46e0f2dd2db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.401390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc17d7-2d2c-4cb6-87a0-91c17c22cf48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.401494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cccbc3-0223-48ad-bf6c-46e0f2dd2db3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.401696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cccbc3-0223-48ad-bf6c-46e0f2dd2db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.402021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cccbc3-0223-48ad-bf6c-46e0f2dd2db3 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.403237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cccbc3-0223-48ad-bf6c-46e0f2dd2db3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.403547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cccbc3-0223-48ad-bf6c-46e0f2dd2db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.404543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc17d7-2d2c-4cb6-87a0-91c17c22cf48 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.404931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cccbc3-0223-48ad-bf6c-46e0f2dd2db3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.413345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 184/350] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.414173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cccbc3-0223-48ad-bf6c-46e0f2dd2db3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.427839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 167/351] 10.222.0.88 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/role_assignments?user.id=883d73b5290d449f902f1c517df80af0&scope.system=all&role.id=699bd71b35c444f6b0f64e4e2b14b682 => generated 510 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.429122 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc17d7-2d2c-4cb6-87a0-91c17c22cf48 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.559563 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.587613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cccbc3-0223-48ad-bf6c-46e0f2dd2db3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.599763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc17d7-2d2c-4cb6-87a0-91c17c22cf48 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.603401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.643778 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c8b7c-749a-43d4-b2b3-38ad9d0350e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.644405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c8b7c-749a-43d4-b2b3-38ad9d0350e9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.644689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c8b7c-749a-43d4-b2b3-38ad9d0350e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.644964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c8b7c-749a-43d4-b2b3-38ad9d0350e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.655001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a61b2c-d207-475b-bcd5-af41e133047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.655711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61b2c-d207-475b-bcd5-af41e133047d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.655995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61b2c-d207-475b-bcd5-af41e133047d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.656335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61b2c-d207-475b-bcd5-af41e133047d None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.657574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a61b2c-d207-475b-bcd5-af41e133047d None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.659177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a61b2c-d207-475b-bcd5-af41e133047d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.660931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 185/352] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.666659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a61b2c-d207-475b-bcd5-af41e133047d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.721470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c8b7c-749a-43d4-b2b3-38ad9d0350e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.722961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c8b7c-749a-43d4-b2b3-38ad9d0350e9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.822322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a61b2c-d207-475b-bcd5-af41e133047d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.835471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 168/353] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:45.843013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c8b7c-749a-43d4-b2b3-38ad9d0350e9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.855800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.882565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d3fc-ac24-4bd6-8728-ab0821f74966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.883246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d3fc-ac24-4bd6-8728-ab0821f74966 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.883532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d3fc-ac24-4bd6-8728-ab0821f74966 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.883809 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d3fc-ac24-4bd6-8728-ab0821f74966 None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.890377 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23d3fc-ac24-4bd6-8728-ab0821f74966 None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.896064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23d3fc-ac24-4bd6-8728-ab0821f74966 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.898085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 186/354] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:45.899174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d3fc-ac24-4bd6-8728-ab0821f74966 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.927723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.986118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c8b7c-749a-43d4-b2b3-38ad9d0350e9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.031194 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d4d0-dc58-4e5f-8771-48e1f61615c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.031840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d4d0-dc58-4e5f-8771-48e1f61615c3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.032124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d4d0-dc58-4e5f-8771-48e1f61615c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.032404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d4d0-dc58-4e5f-8771-48e1f61615c3 None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.033574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196d4d0-dc58-4e5f-8771-48e1f61615c3 None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.035077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196d4d0-dc58-4e5f-8771-48e1f61615c3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.037088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 169/355] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:46.037882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d4d0-dc58-4e5f-8771-48e1f61615c3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.048998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d3fc-ac24-4bd6-8728-ab0821f74966 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.101963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5fe4a-bba3-4957-9648-46ca60d61c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.102537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fe4a-bba3-4957-9648-46ca60d61c04 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.102817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fe4a-bba3-4957-9648-46ca60d61c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.103136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fe4a-bba3-4957-9648-46ca60d61c04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.119748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5fe4a-bba3-4957-9648-46ca60d61c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:46.124392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0ed5fe4a-bba3-4957-9648-46ca60d61c04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:46.127502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:46.128380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:46.129176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:46.131688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 187/356] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:46.132922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d743f5-f295-4c3f-991f-4cad7828c997 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.133207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d743f5-f295-4c3f-991f-4cad7828c997 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.133481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d743f5-f295-4c3f-991f-4cad7828c997 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.134740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 188/357] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:46.139757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d743f5-f295-4c3f-991f-4cad7828c997 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.169368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d4d0-dc58-4e5f-8771-48e1f61615c3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.217693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7ec83-3fb6-4654-b076-f55b23089c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.218363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7ec83-3fb6-4654-b076-f55b23089c12 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.218646 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7ec83-3fb6-4654-b076-f55b23089c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.218919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7ec83-3fb6-4654-b076-f55b23089c12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.219742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7ec83-3fb6-4654-b076-f55b23089c12 None admin] RBAC: Adding query filter params (group.id=1a4c565b99c0477993d55a8c6e4c5cfb, role.id=8689bf0d70184aef9148c6b4a9758b32, scope.project.id=680354d08b5e4597b80901494f3d923c) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:46.220052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7ec83-3fb6-4654-b076-f55b23089c12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.221544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7ec83-3fb6-4654-b076-f55b23089c12 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.228878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 170/358] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/role_assignments?group.id=1a4c565b99c0477993d55a8c6e4c5cfb&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:46.230630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145fcc-d87e-4d84-87cc-73f6d7381c91 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.230855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145fcc-d87e-4d84-87cc-73f6d7381c91 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.231158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145fcc-d87e-4d84-87cc-73f6d7381c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.251764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-96145fcc-d87e-4d84-87cc-73f6d7381c91 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:46.252953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-96145fcc-d87e-4d84-87cc-73f6d7381c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:46.254348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.279552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d743f5-f295-4c3f-991f-4cad7828c997 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.330858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011f538-da93-45b6-af69-f81c254bdde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.331957 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011f538-da93-45b6-af69-f81c254bdde7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.332437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011f538-da93-45b6-af69-f81c254bdde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.332725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011f538-da93-45b6-af69-f81c254bdde7 None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.333963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011f538-da93-45b6-af69-f81c254bdde7 None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.335471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011f538-da93-45b6-af69-f81c254bdde7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.337296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 189/359] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:46.337891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011f538-da93-45b6-af69-f81c254bdde7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.351032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 171/360] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:46.353227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c353a-5a2c-417e-b827-3c9e4dc990b3 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.353724 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c353a-5a2c-417e-b827-3c9e4dc990b3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.354191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c353a-5a2c-417e-b827-3c9e4dc990b3 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.356295 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 172/361] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:46.357936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c353a-5a2c-417e-b827-3c9e4dc990b3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.451390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.483333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011f538-da93-45b6-af69-f81c254bdde7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.507767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c353a-5a2c-417e-b827-3c9e4dc990b3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.546452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513b571-0219-410b-b30c-36e5da85e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.547481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513b571-0219-410b-b30c-36e5da85e80e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.548011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513b571-0219-410b-b30c-36e5da85e80e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.548428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513b571-0219-410b-b30c-36e5da85e80e None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.549537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513b571-0219-410b-b30c-36e5da85e80e None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:46.550642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513b571-0219-410b-b30c-36e5da85e80e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.552856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513b571-0219-410b-b30c-36e5da85e80e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.563467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3a74-8ce4-42d8-ae88-26159cf00fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.564189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3a74-8ce4-42d8-ae88-26159cf00fdf None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.564545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3a74-8ce4-42d8-ae88-26159cf00fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.564894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3a74-8ce4-42d8-ae88-26159cf00fdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.565293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 190/362] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:46.566055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3a74-8ce4-42d8-ae88-26159cf00fdf None admin] RBAC: Adding query filter params (group.id=1a4c565b99c0477993d55a8c6e4c5cfb, role.id=0abc70600d6f4948a59e9a14d33aa289, scope.project.id=680354d08b5e4597b80901494f3d923c) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:46.566446 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3a74-8ce4-42d8-ae88-26159cf00fdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.571084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d874-10e3-4e8d-9b9c-a96f6b2912cd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.571210 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3a74-8ce4-42d8-ae88-26159cf00fdf None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.571568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d874-10e3-4e8d-9b9c-a96f6b2912cd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.571775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d874-10e3-4e8d-9b9c-a96f6b2912cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.578735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 173/363] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/role_assignments?group.id=1a4c565b99c0477993d55a8c6e4c5cfb&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=0abc70600d6f4948a59e9a14d33aa289 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:46.579676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3a74-8ce4-42d8-ae88-26159cf00fdf None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.597112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c688d874-10e3-4e8d-9b9c-a96f6b2912cd None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:46.599311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c688d874-10e3-4e8d-9b9c-a96f6b2912cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:46.604228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.707470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 191/364] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:46.717429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3a74-8ce4-42d8-ae88-26159cf00fdf None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.718036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d874-10e3-4e8d-9b9c-a96f6b2912cd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.754314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.761654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bd491-1563-41c1-8968-abedc115aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.762444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bd491-1563-41c1-8968-abedc115aa08 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.762800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bd491-1563-41c1-8968-abedc115aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.763199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bd491-1563-41c1-8968-abedc115aa08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.873177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bd491-1563-41c1-8968-abedc115aa08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.874664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bd491-1563-41c1-8968-abedc115aa08 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.877014 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d874-10e3-4e8d-9b9c-a96f6b2912cd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.926210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758399bc-e09e-4002-8d2b-5d0562ec1b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.927321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758399bc-e09e-4002-8d2b-5d0562ec1b78 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.927816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758399bc-e09e-4002-8d2b-5d0562ec1b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.928277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758399bc-e09e-4002-8d2b-5d0562ec1b78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.940934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.945376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758399bc-e09e-4002-8d2b-5d0562ec1b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-758399bc-e09e-4002-8d2b-5d0562ec1b78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:46.951705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:46.953457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:46.954334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 192/365] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:46.961357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758399bc-e09e-4002-8d2b-5d0562ec1b78 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.015991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 174/366] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:47.024126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bd491-1563-41c1-8968-abedc115aa08 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.061342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.089604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758399bc-e09e-4002-8d2b-5d0562ec1b78 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.127252 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9d6ef-7a3e-4215-8a8e-4c1dfd896133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.127797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9d6ef-7a3e-4215-8a8e-4c1dfd896133 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.128079 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9d6ef-7a3e-4215-8a8e-4c1dfd896133 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.128356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9d6ef-7a3e-4215-8a8e-4c1dfd896133 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.129038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9d6ef-7a3e-4215-8a8e-4c1dfd896133 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:47.129344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9d6ef-7a3e-4215-8a8e-4c1dfd896133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.130879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9d6ef-7a3e-4215-8a8e-4c1dfd896133 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.139525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 193/367] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:47.146707 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9d6ef-7a3e-4215-8a8e-4c1dfd896133 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.147249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bd491-1563-41c1-8968-abedc115aa08 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.191723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8d88b-0399-4eb9-be22-b878364aba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.192740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8d88b-0399-4eb9-be22-b878364aba1c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.193219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8d88b-0399-4eb9-be22-b878364aba1c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.193781 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8d88b-0399-4eb9-be22-b878364aba1c None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.195148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8d88b-0399-4eb9-be22-b878364aba1c None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.196991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8d88b-0399-4eb9-be22-b878364aba1c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.199385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 175/368] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:47.200586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8d88b-0399-4eb9-be22-b878364aba1c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.217088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.257239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9d6ef-7a3e-4215-8a8e-4c1dfd896133 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.294762 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0b563-93b8-4c4d-ba62-e1def48118e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.295591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b563-93b8-4c4d-ba62-e1def48118e1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.295976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b563-93b8-4c4d-ba62-e1def48118e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.296352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0b563-93b8-4c4d-ba62-e1def48118e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.307186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0b563-93b8-4c4d-ba62-e1def48118e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-70f0b563-93b8-4c4d-ba62-e1def48118e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:47.313206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:47.314335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:47.315391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:47.316179 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.317107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 194/369] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:47.317996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0b563-93b8-4c4d-ba62-e1def48118e1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.321345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8d88b-0399-4eb9-be22-b878364aba1c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.364360 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c152b1-66c8-46cc-a9b3-f2dfdc04becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.365384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c152b1-66c8-46cc-a9b3-f2dfdc04becd None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.365805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c152b1-66c8-46cc-a9b3-f2dfdc04becd None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.366225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c152b1-66c8-46cc-a9b3-f2dfdc04becd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.426778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0b563-93b8-4c4d-ba62-e1def48118e1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.446584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c152b1-66c8-46cc-a9b3-f2dfdc04becd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.449213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c152b1-66c8-46cc-a9b3-f2dfdc04becd None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.457818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.472286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e246c-8911-4a28-af2e-69d86a953f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.473136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e246c-8911-4a28-af2e-69d86a953f57 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.479575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e246c-8911-4a28-af2e-69d86a953f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.479575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e246c-8911-4a28-af2e-69d86a953f57 None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.479575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e246c-8911-4a28-af2e-69d86a953f57 None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.479575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e246c-8911-4a28-af2e-69d86a953f57 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.479575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 195/370] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:47.479575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e246c-8911-4a28-af2e-69d86a953f57 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.560639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.570666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 176/371] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:47.571605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c152b1-66c8-46cc-a9b3-f2dfdc04becd None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.589244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e246c-8911-4a28-af2e-69d86a953f57 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.637596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6eefb-6038-4130-a318-1615c901af86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.638250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6eefb-6038-4130-a318-1615c901af86 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.638462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6eefb-6038-4130-a318-1615c901af86 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.638732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6eefb-6038-4130-a318-1615c901af86 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.639464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6eefb-6038-4130-a318-1615c901af86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:47.640000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6eefb-6038-4130-a318-1615c901af86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.641556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6eefb-6038-4130-a318-1615c901af86 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.651238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 196/372] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:47.652321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6eefb-6038-4130-a318-1615c901af86 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.718328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c152b1-66c8-46cc-a9b3-f2dfdc04becd None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.732487 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.777288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9778af-52eb-4a2f-b85d-fdf994e69a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.777901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9778af-52eb-4a2f-b85d-fdf994e69a4c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.778184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9778af-52eb-4a2f-b85d-fdf994e69a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.778457 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9778af-52eb-4a2f-b85d-fdf994e69a4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.779225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9778af-52eb-4a2f-b85d-fdf994e69a4c None admin] RBAC: Adding query filter params (group.id=1a4c565b99c0477993d55a8c6e4c5cfb, role.id=8689bf0d70184aef9148c6b4a9758b32, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:47.779539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9778af-52eb-4a2f-b85d-fdf994e69a4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.781420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9778af-52eb-4a2f-b85d-fdf994e69a4c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.788834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 177/373] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/role_assignments?group.id=1a4c565b99c0477993d55a8c6e4c5cfb&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:47.789706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9778af-52eb-4a2f-b85d-fdf994e69a4c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.816621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6eefb-6038-4130-a318-1615c901af86 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.887564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.889880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca286a-2d01-4fbd-9eb7-bd1c7b059ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.890677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca286a-2d01-4fbd-9eb7-bd1c7b059ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.890966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca286a-2d01-4fbd-9eb7-bd1c7b059ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.891263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca286a-2d01-4fbd-9eb7-bd1c7b059ce0 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.895940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca286a-2d01-4fbd-9eb7-bd1c7b059ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.902573 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca286a-2d01-4fbd-9eb7-bd1c7b059ce0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.902573 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 197/374] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:47.908160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca286a-2d01-4fbd-9eb7-bd1c7b059ce0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.933161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9778af-52eb-4a2f-b85d-fdf994e69a4c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.973103 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68926cd-24fd-4184-b73c-372ca1d37f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.973669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68926cd-24fd-4184-b73c-372ca1d37f2a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.973957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68926cd-24fd-4184-b73c-372ca1d37f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.974237 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68926cd-24fd-4184-b73c-372ca1d37f2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.056512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca286a-2d01-4fbd-9eb7-bd1c7b059ce0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.081937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.095077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a357f-dfde-4837-97db-01d72d4bc454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.096493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a357f-dfde-4837-97db-01d72d4bc454 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.096493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a357f-dfde-4837-97db-01d72d4bc454 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.096493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a357f-dfde-4837-97db-01d72d4bc454 None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.097443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a357f-dfde-4837-97db-01d72d4bc454 None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.098994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a357f-dfde-4837-97db-01d72d4bc454 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.101061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 198/375] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:48.105307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68926cd-24fd-4184-b73c-372ca1d37f2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.106917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68926cd-24fd-4184-b73c-372ca1d37f2a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.109277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a357f-dfde-4837-97db-01d72d4bc454 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.203417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.226567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a357f-dfde-4837-97db-01d72d4bc454 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.238588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 178/376] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:48.244617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68926cd-24fd-4184-b73c-372ca1d37f2a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.264529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceee0fc-388f-425f-a58e-8e9da87ad438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.265150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceee0fc-388f-425f-a58e-8e9da87ad438 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.265484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceee0fc-388f-425f-a58e-8e9da87ad438 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.265767 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceee0fc-388f-425f-a58e-8e9da87ad438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.266502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceee0fc-388f-425f-a58e-8e9da87ad438 None admin] RBAC: Adding query filter params (group.id=1a4c565b99c0477993d55a8c6e4c5cfb, role.id=0abc70600d6f4948a59e9a14d33aa289, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:48.266817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceee0fc-388f-425f-a58e-8e9da87ad438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.268296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceee0fc-388f-425f-a58e-8e9da87ad438 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.274182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 199/377] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/role_assignments?group.id=1a4c565b99c0477993d55a8c6e4c5cfb&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=0abc70600d6f4948a59e9a14d33aa289 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:48.359997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68926cd-24fd-4184-b73c-372ca1d37f2a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.398748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76fe28-1464-42c3-bbdc-ba2c7d587761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.399436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76fe28-1464-42c3-bbdc-ba2c7d587761 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.399720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76fe28-1464-42c3-bbdc-ba2c7d587761 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.399994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76fe28-1464-42c3-bbdc-ba2c7d587761 None admin] PATH_INFO: `/v3/projects/8ee2c938bc0d4468aba227f5962adcb7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.401162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76fe28-1464-42c3-bbdc-ba2c7d587761 None admin] RBAC: Authorizing `identity:get_project(project_id=8ee2c938bc0d4468aba227f5962adcb7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.402714 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76fe28-1464-42c3-bbdc-ba2c7d587761 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.404838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 179/378] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/projects/8ee2c938bc0d4468aba227f5962adcb7 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:48.410521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceee0fc-388f-425f-a58e-8e9da87ad438 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.487302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.543740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceee0fc-388f-425f-a58e-8e9da87ad438 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.583059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed27095-2950-4df4-8733-d11e4bd7b7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.583713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed27095-2950-4df4-8733-d11e4bd7b7cd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.584000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed27095-2950-4df4-8733-d11e4bd7b7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.584277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed27095-2950-4df4-8733-d11e4bd7b7cd None admin] PATH_INFO: `/v3/groups/d5980bf7e3744520849a2339d4568989` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.595869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed27095-2950-4df4-8733-d11e4bd7b7cd None admin] RBAC: Authorizing `identity:get_group(group_id=d5980bf7e3744520849a2339d4568989)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.597383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed27095-2950-4df4-8733-d11e4bd7b7cd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.599459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 200/379] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/groups/d5980bf7e3744520849a2339d4568989 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:48.605912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76fe28-1464-42c3-bbdc-ba2c7d587761 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.651257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.747256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76fe28-1464-42c3-bbdc-ba2c7d587761 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.784634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d125-d41d-424b-b943-e0bb5d1f153d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.785161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d125-d41d-424b-b943-e0bb5d1f153d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.785161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d125-d41d-424b-b943-e0bb5d1f153d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.786784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 201/380] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:48.792124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900358dd-a6e7-4f72-af41-9830256af978 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.792456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900358dd-a6e7-4f72-af41-9830256af978 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.792740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900358dd-a6e7-4f72-af41-9830256af978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.796514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fd4b3-6613-401c-bfa5-4dba08881699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.797139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd4b3-6613-401c-bfa5-4dba08881699 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.797427 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd4b3-6613-401c-bfa5-4dba08881699 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.797703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fd4b3-6613-401c-bfa5-4dba08881699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.798447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fd4b3-6613-401c-bfa5-4dba08881699 None admin] RBAC: Adding query filter params (group.id=d5980bf7e3744520849a2339d4568989, role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=8ee2c938bc0d4468aba227f5962adcb7) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:48.798760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fd4b3-6613-401c-bfa5-4dba08881699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.800232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fd4b3-6613-401c-bfa5-4dba08881699 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.806606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 180/381] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/role_assignments?group.id=d5980bf7e3744520849a2339d4568989&scope.project.id=8ee2c938bc0d4468aba227f5962adcb7&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:48.820512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-900358dd-a6e7-4f72-af41-9830256af978 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:48.821736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-900358dd-a6e7-4f72-af41-9830256af978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:48.901502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 202/382] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:49.134071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac15b1e-2e1b-438a-a57c-c02a9f0f21e9 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.134418 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac15b1e-2e1b-438a-a57c-c02a9f0f21e9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.134594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac15b1e-2e1b-438a-a57c-c02a9f0f21e9 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.136006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 181/383] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:49.143182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29702-5254-4baf-af0e-4fa45b1b0d99 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.143649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29702-5254-4baf-af0e-4fa45b1b0d99 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.143951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29702-5254-4baf-af0e-4fa45b1b0d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.172078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-03f29702-5254-4baf-af0e-4fa45b1b0d99 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:49.173430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-03f29702-5254-4baf-af0e-4fa45b1b0d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:49.229714 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac15b1e-2e1b-438a-a57c-c02a9f0f21e9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.233883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.267544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 203/384] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:49.355965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.365541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac15b1e-2e1b-438a-a57c-c02a9f0f21e9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.406413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b600a-3a11-4c35-8953-70483b815b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.407541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b600a-3a11-4c35-8953-70483b815b14 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.408013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b600a-3a11-4c35-8953-70483b815b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.408475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b600a-3a11-4c35-8953-70483b815b14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.420199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b600a-3a11-4c35-8953-70483b815b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-9c6b600a-3a11-4c35-8953-70483b815b14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:49.425495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:49.426502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:49.427312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:49.429723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 182/385] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:49.436724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f29702-5254-4baf-af0e-4fa45b1b0d99 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.562515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f29702-5254-4baf-af0e-4fa45b1b0d99 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.601666 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2246f-39f7-4120-858a-af544f1710e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.602638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2246f-39f7-4120-858a-af544f1710e9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.603146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2246f-39f7-4120-858a-af544f1710e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.603625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2246f-39f7-4120-858a-af544f1710e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.604489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2246f-39f7-4120-858a-af544f1710e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:49.605696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2246f-39f7-4120-858a-af544f1710e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.608316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2246f-39f7-4120-858a-af544f1710e9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.621175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 204/386] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:49.627354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b600a-3a11-4c35-8953-70483b815b14 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.675525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2246f-39f7-4120-858a-af544f1710e9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.736645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.804171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b600a-3a11-4c35-8953-70483b815b14 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.858844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2246f-39f7-4120-858a-af544f1710e9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.889415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872018ac-bce0-4913-bfcc-3a05b2b1ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.890517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872018ac-bce0-4913-bfcc-3a05b2b1ad3f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.891725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872018ac-bce0-4913-bfcc-3a05b2b1ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.892433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872018ac-bce0-4913-bfcc-3a05b2b1ad3f None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.896645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872018ac-bce0-4913-bfcc-3a05b2b1ad3f None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.899588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872018ac-bce0-4913-bfcc-3a05b2b1ad3f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.901611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 183/387] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:49.909244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872018ac-bce0-4913-bfcc-3a05b2b1ad3f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.954765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.969013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc28e3-e6a1-48bd-88a3-93f5e93c1893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.969013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc28e3-e6a1-48bd-88a3-93f5e93c1893 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.969013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc28e3-e6a1-48bd-88a3-93f5e93c1893 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.969619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc28e3-e6a1-48bd-88a3-93f5e93c1893 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.000926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc28e3-e6a1-48bd-88a3-93f5e93c1893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1dfc28e3-e6a1-48bd-88a3-93f5e93c1893 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:50.006296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:50.007223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:50.008759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 205/388] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:50.013725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc28e3-e6a1-48bd-88a3-93f5e93c1893 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.059849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872018ac-bce0-4913-bfcc-3a05b2b1ad3f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.098376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ad42-a0ec-4ae8-b587-b7a50105dcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.099479 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ad42-a0ec-4ae8-b587-b7a50105dcde None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.100091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ad42-a0ec-4ae8-b587-b7a50105dcde None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.100555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ad42-a0ec-4ae8-b587-b7a50105dcde None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.101976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683ad42-a0ec-4ae8-b587-b7a50105dcde None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.103762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683ad42-a0ec-4ae8-b587-b7a50105dcde None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.109310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 184/389] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.113399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ad42-a0ec-4ae8-b587-b7a50105dcde None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.203127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.210858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc28e3-e6a1-48bd-88a3-93f5e93c1893 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.221594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.233313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ad42-a0ec-4ae8-b587-b7a50105dcde None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.272586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7a9b-7b2b-440f-91c2-90eaa385bbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.273627 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7a9b-7b2b-440f-91c2-90eaa385bbe9 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.274101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7a9b-7b2b-440f-91c2-90eaa385bbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.275699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7a9b-7b2b-440f-91c2-90eaa385bbe9 None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c/groups/1a4c565b99c0477993d55a8c6e4c5cfb/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.278436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d7a9b-7b2b-440f-91c2-90eaa385bbe9 None admin] RBAC: Authorizing `identity:create_grant(project_id=680354d08b5e4597b80901494f3d923c, group_id=1a4c565b99c0477993d55a8c6e4c5cfb, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.279754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9b640-5037-40b8-8b19-6e3b67824423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.280388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9b640-5037-40b8-8b19-6e3b67824423 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.280658 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d7a9b-7b2b-440f-91c2-90eaa385bbe9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.280770 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9b640-5037-40b8-8b19-6e3b67824423 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.280985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9b640-5037-40b8-8b19-6e3b67824423 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.281626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9b640-5037-40b8-8b19-6e3b67824423 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:50.281938 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9b640-5037-40b8-8b19-6e3b67824423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.283357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9b640-5037-40b8-8b19-6e3b67824423 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.293828 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 206/390] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:50.298234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9b640-5037-40b8-8b19-6e3b67824423 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.367669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 185/391] 10.222.0.88 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:50 2022] PUT /identity/v3/projects/680354d08b5e4597b80901494f3d923c/groups/1a4c565b99c0477993d55a8c6e4c5cfb/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:26:50.415988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9b640-5037-40b8-8b19-6e3b67824423 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.461866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc4bf7-96e9-4345-9c26-f2b142135392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.462443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc4bf7-96e9-4345-9c26-f2b142135392 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.462726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc4bf7-96e9-4345-9c26-f2b142135392 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.462999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc4bf7-96e9-4345-9c26-f2b142135392 None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.464792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc4bf7-96e9-4345-9c26-f2b142135392 None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.466363 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc4bf7-96e9-4345-9c26-f2b142135392 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.468439 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 207/392] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:50.473983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7a9b-7b2b-440f-91c2-90eaa385bbe9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.563228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af229d9-b28d-4a74-b273-bb4d4a8ba24c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.563509 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af229d9-b28d-4a74-b273-bb4d4a8ba24c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.563829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af229d9-b28d-4a74-b273-bb4d4a8ba24c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.565187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 208/393] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:50.571254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124df49-9c18-4f28-90d3-6eeb2daec643 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.571545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124df49-9c18-4f28-90d3-6eeb2daec643 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.571816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124df49-9c18-4f28-90d3-6eeb2daec643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.615740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7a9b-7b2b-440f-91c2-90eaa385bbe9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.620195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5124df49-9c18-4f28-90d3-6eeb2daec643 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:50.622121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5124df49-9c18-4f28-90d3-6eeb2daec643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:50.650575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.662829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abec9d4-77a8-42a2-9191-569649ffbf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.664781 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abec9d4-77a8-42a2-9191-569649ffbf4c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.666181 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abec9d4-77a8-42a2-9191-569649ffbf4c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.666848 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abec9d4-77a8-42a2-9191-569649ffbf4c None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.670081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abec9d4-77a8-42a2-9191-569649ffbf4c None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.673126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abec9d4-77a8-42a2-9191-569649ffbf4c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.675966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 186/394] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.681507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abec9d4-77a8-42a2-9191-569649ffbf4c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.709490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.720845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 209/395] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 03:26:50.807865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abec9d4-77a8-42a2-9191-569649ffbf4c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.851982 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaa4f3-5a79-406e-bfa2-414f5b3c8128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.853268 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaa4f3-5a79-406e-bfa2-414f5b3c8128 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.854059 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaa4f3-5a79-406e-bfa2-414f5b3c8128 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.855349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaa4f3-5a79-406e-bfa2-414f5b3c8128 None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c/groups/1a4c565b99c0477993d55a8c6e4c5cfb/roles/0abc70600d6f4948a59e9a14d33aa289` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.859203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeaa4f3-5a79-406e-bfa2-414f5b3c8128 None admin] RBAC: Authorizing `identity:create_grant(project_id=680354d08b5e4597b80901494f3d923c, group_id=1a4c565b99c0477993d55a8c6e4c5cfb, role_id=0abc70600d6f4948a59e9a14d33aa289)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.861363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeaa4f3-5a79-406e-bfa2-414f5b3c8128 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.936876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 187/396] 10.222.0.88 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:50 2022] PUT /identity/v3/projects/680354d08b5e4597b80901494f3d923c/groups/1a4c565b99c0477993d55a8c6e4c5cfb/roles/0abc70600d6f4948a59e9a14d33aa289 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:51.050978 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1282a-de67-4c99-bd34-1c4532dcd3e2 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.051496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1282a-de67-4c99-bd34-1c4532dcd3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.051496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1282a-de67-4c99-bd34-1c4532dcd3e2 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.053095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 210/397] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:51.059446 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf39760-023d-4958-bdfe-d98924b7fbdc None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.060073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf39760-023d-4958-bdfe-d98924b7fbdc None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.060546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf39760-023d-4958-bdfe-d98924b7fbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.087017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5bf39760-023d-4958-bdfe-d98924b7fbdc None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:51.088632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5bf39760-023d-4958-bdfe-d98924b7fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:51.153916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1282a-de67-4c99-bd34-1c4532dcd3e2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.179110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 188/398] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:51.268484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1282a-de67-4c99-bd34-1c4532dcd3e2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.304855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1de8e-5e58-449b-830d-cbb5083d9b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.305808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1de8e-5e58-449b-830d-cbb5083d9b83 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.306302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1de8e-5e58-449b-830d-cbb5083d9b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.306837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1de8e-5e58-449b-830d-cbb5083d9b83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.314526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a419a-4d57-4948-905c-aaba072fc313 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.314970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a419a-4d57-4948-905c-aaba072fc313 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.315378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a419a-4d57-4948-905c-aaba072fc313 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.316954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 189/399] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:51.322243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d3a4a-6b81-4932-bc42-be48ac29243f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.322694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d3a4a-6b81-4932-bc42-be48ac29243f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.323176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d3a4a-6b81-4932-bc42-be48ac29243f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.324938 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1de8e-5e58-449b-830d-cbb5083d9b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-78f1de8e-5e58-449b-830d-cbb5083d9b83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:51.329281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:51.330356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:51.331449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:51.333161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 211/400] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:51.343095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1de8e-5e58-449b-830d-cbb5083d9b83 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.361474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.368178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ab7d3a4a-6b81-4932-bc42-be48ac29243f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:51.369634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ab7d3a4a-6b81-4932-bc42-be48ac29243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:51.375393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.462647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1de8e-5e58-449b-830d-cbb5083d9b83 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.497114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 190/401] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:51.498248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d3a4a-6b81-4932-bc42-be48ac29243f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.507904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f889173-ba7f-427c-a499-7c29f403228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.508577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889173-ba7f-427c-a499-7c29f403228b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.508855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889173-ba7f-427c-a499-7c29f403228b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.509125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889173-ba7f-427c-a499-7c29f403228b None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.509863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f889173-ba7f-427c-a499-7c29f403228b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:51.510165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f889173-ba7f-427c-a499-7c29f403228b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.515005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f889173-ba7f-427c-a499-7c29f403228b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.527340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 212/402] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:51.534714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f889173-ba7f-427c-a499-7c29f403228b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.657821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.666741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d3a4a-6b81-4932-bc42-be48ac29243f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.678175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f889173-ba7f-427c-a499-7c29f403228b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.718251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475755c-a717-45cb-a3f5-d2da32d8e9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.718894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475755c-a717-45cb-a3f5-d2da32d8e9ea None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.719207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475755c-a717-45cb-a3f5-d2da32d8e9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.719524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475755c-a717-45cb-a3f5-d2da32d8e9ea None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.720874 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475755c-a717-45cb-a3f5-d2da32d8e9ea None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.722708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475755c-a717-45cb-a3f5-d2da32d8e9ea None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.724671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 213/403] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:51.730861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475755c-a717-45cb-a3f5-d2da32d8e9ea None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.732893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f450af1-ac8a-47fa-8358-8b593b3263be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.733546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f450af1-ac8a-47fa-8358-8b593b3263be None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.733832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f450af1-ac8a-47fa-8358-8b593b3263be None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.734229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f450af1-ac8a-47fa-8358-8b593b3263be None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.749837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.760057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f450af1-ac8a-47fa-8358-8b593b3263be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-5f450af1-ac8a-47fa-8358-8b593b3263be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:51.765473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:51.766339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:51.767565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 191/404] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:51.788447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f450af1-ac8a-47fa-8358-8b593b3263be None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.848607 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475755c-a717-45cb-a3f5-d2da32d8e9ea None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.890641 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e2c6c-abc3-4321-9dc1-4baf3af1820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.891335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e2c6c-abc3-4321-9dc1-4baf3af1820f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.891613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e2c6c-abc3-4321-9dc1-4baf3af1820f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.891883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e2c6c-abc3-4321-9dc1-4baf3af1820f None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.893038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e2c6c-abc3-4321-9dc1-4baf3af1820f None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.894494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e2c6c-abc3-4321-9dc1-4baf3af1820f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.896678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 214/405] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:51.897442 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e2c6c-abc3-4321-9dc1-4baf3af1820f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.922203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.952717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f450af1-ac8a-47fa-8358-8b593b3263be None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.996473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950c7e2-eae2-44c9-9acc-cda2f7222c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.997106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950c7e2-eae2-44c9-9acc-cda2f7222c14 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.997390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950c7e2-eae2-44c9-9acc-cda2f7222c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.997666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950c7e2-eae2-44c9-9acc-cda2f7222c14 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.998346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950c7e2-eae2-44c9-9acc-cda2f7222c14 None admin] RBAC: Adding query filter params (name=member) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:51.998651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950c7e2-eae2-44c9-9acc-cda2f7222c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.000966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950c7e2-eae2-44c9-9acc-cda2f7222c14 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.011646 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 192/406] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.012414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950c7e2-eae2-44c9-9acc-cda2f7222c14 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.020165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e2c6c-abc3-4321-9dc1-4baf3af1820f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.057530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccc2a3-93d3-4d51-8dd9-bbb28d14054b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.058230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc2a3-93d3-4d51-8dd9-bbb28d14054b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.058452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc2a3-93d3-4d51-8dd9-bbb28d14054b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.058746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc2a3-93d3-4d51-8dd9-bbb28d14054b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.070683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccc2a3-93d3-4d51-8dd9-bbb28d14054b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-dcccc2a3-93d3-4d51-8dd9-bbb28d14054b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:52.076421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:52.077351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:26:52.078139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 215/407] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:52.078799 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccc2a3-93d3-4d51-8dd9-bbb28d14054b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.094954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.153610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950c7e2-eae2-44c9-9acc-cda2f7222c14 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.166290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.193988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccc2a3-93d3-4d51-8dd9-bbb28d14054b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.194738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445aa6c8-2f6f-4a9d-9373-834af42a5712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.195664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aa6c8-2f6f-4a9d-9373-834af42a5712 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.197414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aa6c8-2f6f-4a9d-9373-834af42a5712 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.197890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aa6c8-2f6f-4a9d-9373-834af42a5712 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/groups/1a4c565b99c0477993d55a8c6e4c5cfb/roles/0abc70600d6f4948a59e9a14d33aa289` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.201152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445aa6c8-2f6f-4a9d-9373-834af42a5712 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce37eeb36b8d44b0ae5c523d52045e8b, group_id=1a4c565b99c0477993d55a8c6e4c5cfb, role_id=0abc70600d6f4948a59e9a14d33aa289)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.202862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445aa6c8-2f6f-4a9d-9373-834af42a5712 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.234421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f5ac5-5683-4edc-b946-66afa5a7837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.235794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f5ac5-5683-4edc-b946-66afa5a7837b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.236125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f5ac5-5683-4edc-b946-66afa5a7837b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.236404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f5ac5-5683-4edc-b946-66afa5a7837b None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.237729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f5ac5-5683-4edc-b946-66afa5a7837b None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.239374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f5ac5-5683-4edc-b946-66afa5a7837b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.242809 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 216/408] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.242809 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f5ac5-5683-4edc-b946-66afa5a7837b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.299893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 193/409] 10.222.0.88 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:52 2022] PUT /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/groups/1a4c565b99c0477993d55a8c6e4c5cfb/roles/0abc70600d6f4948a59e9a14d33aa289 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:52.301519 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445aa6c8-2f6f-4a9d-9373-834af42a5712 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.348005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f5ac5-5683-4edc-b946-66afa5a7837b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.384998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19287d-1762-4348-af36-1b5063b1fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.385614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19287d-1762-4348-af36-1b5063b1fb5e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.385915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19287d-1762-4348-af36-1b5063b1fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.386191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19287d-1762-4348-af36-1b5063b1fb5e None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.386868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19287d-1762-4348-af36-1b5063b1fb5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:52.387202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19287d-1762-4348-af36-1b5063b1fb5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.388890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19287d-1762-4348-af36-1b5063b1fb5e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.397944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 217/410] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.408229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19287d-1762-4348-af36-1b5063b1fb5e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.424287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.481546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445aa6c8-2f6f-4a9d-9373-834af42a5712 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.520866 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.530722 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19287d-1762-4348-af36-1b5063b1fb5e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.556699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ef5a5-84d1-4911-a334-9b4d7c75d9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.557920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ef5a5-84d1-4911-a334-9b4d7c75d9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.558835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ef5a5-84d1-4911-a334-9b4d7c75d9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.558835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ef5a5-84d1-4911-a334-9b4d7c75d9c8 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.560868 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ef5a5-84d1-4911-a334-9b4d7c75d9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.563676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ef5a5-84d1-4911-a334-9b4d7c75d9c8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.567111 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 194/411] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.576708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ef5a5-84d1-4911-a334-9b4d7c75d9c8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.581587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65539c6-df40-4eea-8222-49828d5d4e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.582470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65539c6-df40-4eea-8222-49828d5d4e95 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.582958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65539c6-df40-4eea-8222-49828d5d4e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.583475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65539c6-df40-4eea-8222-49828d5d4e95 None admin] PATH_INFO: `/v3/groups/d5980bf7e3744520849a2339d4568989` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.585734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65539c6-df40-4eea-8222-49828d5d4e95 None admin] RBAC: Authorizing `identity:get_group(group_id=d5980bf7e3744520849a2339d4568989)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.588354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65539c6-df40-4eea-8222-49828d5d4e95 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.590755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 218/412] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/groups/d5980bf7e3744520849a2339d4568989 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.596990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65539c6-df40-4eea-8222-49828d5d4e95 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.691807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.717114 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65539c6-df40-4eea-8222-49828d5d4e95 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.744362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ef5a5-84d1-4911-a334-9b4d7c75d9c8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.763118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90e933-e6de-4b8c-af54-e94113945951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.764086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90e933-e6de-4b8c-af54-e94113945951 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.764559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90e933-e6de-4b8c-af54-e94113945951 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.765092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90e933-e6de-4b8c-af54-e94113945951 None admin] PATH_INFO: `/v3/projects/8ee2c938bc0d4468aba227f5962adcb7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.768060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90e933-e6de-4b8c-af54-e94113945951 None admin] RBAC: Authorizing `identity:get_project(project_id=8ee2c938bc0d4468aba227f5962adcb7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.769778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90e933-e6de-4b8c-af54-e94113945951 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.771843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 219/413] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/projects/8ee2c938bc0d4468aba227f5962adcb7 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:52.779230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90e933-e6de-4b8c-af54-e94113945951 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.789846 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a534b-84f9-43f4-a672-40316dd502d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.790524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a534b-84f9-43f4-a672-40316dd502d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.790817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a534b-84f9-43f4-a672-40316dd502d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.791117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a534b-84f9-43f4-a672-40316dd502d1 None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/groups/1a4c565b99c0477993d55a8c6e4c5cfb/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.796376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a534b-84f9-43f4-a672-40316dd502d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce37eeb36b8d44b0ae5c523d52045e8b, group_id=1a4c565b99c0477993d55a8c6e4c5cfb, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.797831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a534b-84f9-43f4-a672-40316dd502d1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.887086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 195/414] 10.222.0.88 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:52 2022] PUT /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b/groups/1a4c565b99c0477993d55a8c6e4c5cfb/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:52.911089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90e933-e6de-4b8c-af54-e94113945951 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.976954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfbc7c-40cd-43fe-a61f-facd7ca3f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.978092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfbc7c-40cd-43fe-a61f-facd7ca3f441 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.978582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfbc7c-40cd-43fe-a61f-facd7ca3f441 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.979089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfbc7c-40cd-43fe-a61f-facd7ca3f441 None admin] PATH_INFO: `/v3/projects/8ee2c938bc0d4468aba227f5962adcb7/groups/d5980bf7e3744520849a2339d4568989/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.985923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfbc7c-40cd-43fe-a61f-facd7ca3f441 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ee2c938bc0d4468aba227f5962adcb7, group_id=d5980bf7e3744520849a2339d4568989, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.988828 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfbc7c-40cd-43fe-a61f-facd7ca3f441 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.062640 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 220/415] 10.222.0.88 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:52 2022] PUT /identity/v3/projects/8ee2c938bc0d4468aba227f5962adcb7/groups/d5980bf7e3744520849a2339d4568989/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:26:53.610639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ccb84-6087-4fa4-86ff-fcb1f91a63fb None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.611174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ccb84-6087-4fa4-86ff-fcb1f91a63fb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.611248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ccb84-6087-4fa4-86ff-fcb1f91a63fb None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.612676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 196/416] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:53.620087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ed38-a6d4-44a7-9882-50834283744b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.620441 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ed38-a6d4-44a7-9882-50834283744b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.620776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ed38-a6d4-44a7-9882-50834283744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.628154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.644053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e6c8ed38-a6d4-44a7-9882-50834283744b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:53.645801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e6c8ed38-a6d4-44a7-9882-50834283744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:53.737300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 221/417] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:53.745426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d007b-0576-44ac-8539-7b5555d9e0c9 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.745920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d007b-0576-44ac-8539-7b5555d9e0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.746392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d007b-0576-44ac-8539-7b5555d9e0c9 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.748927 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 197/418] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:53.765490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb9bd-7589-496c-a6fc-db38041e5489 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.765791 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb9bd-7589-496c-a6fc-db38041e5489 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.766071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb9bd-7589-496c-a6fc-db38041e5489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.791108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-58ceb9bd-7589-496c-a6fc-db38041e5489 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:53.791108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-58ceb9bd-7589-496c-a6fc-db38041e5489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:53.878121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 222/419] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:54.093546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d007b-0576-44ac-8539-7b5555d9e0c9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.157240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.235549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d007b-0576-44ac-8539-7b5555d9e0c9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.290633 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edc634-6749-4523-ac9d-410fffd99cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.291302 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edc634-6749-4523-ac9d-410fffd99cbc None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.291585 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edc634-6749-4523-ac9d-410fffd99cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.291863 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edc634-6749-4523-ac9d-410fffd99cbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.308892 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edc634-6749-4523-ac9d-410fffd99cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-e7edc634-6749-4523-ac9d-410fffd99cbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:54.314298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:54.315276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:54.316510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 198/420] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:54.321522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceb9bd-7589-496c-a6fc-db38041e5489 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.413522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.425344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edc634-6749-4523-ac9d-410fffd99cbc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.467085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceb9bd-7589-496c-a6fc-db38041e5489 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.533401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98faa33-5fd5-4aed-bb8d-29f20e7e7e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.534116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98faa33-5fd5-4aed-bb8d-29f20e7e7e02 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.534406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98faa33-5fd5-4aed-bb8d-29f20e7e7e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.534685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98faa33-5fd5-4aed-bb8d-29f20e7e7e02 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.535393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98faa33-5fd5-4aed-bb8d-29f20e7e7e02 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:54.535709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98faa33-5fd5-4aed-bb8d-29f20e7e7e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.537228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98faa33-5fd5-4aed-bb8d-29f20e7e7e02 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.548132 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edc634-6749-4523-ac9d-410fffd99cbc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.553349 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 223/421] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:54.559663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.559814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98faa33-5fd5-4aed-bb8d-29f20e7e7e02 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.592178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d3f3f-89c8-4e1c-9601-6b5f191f7161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.593422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d3f3f-89c8-4e1c-9601-6b5f191f7161 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.594480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d3f3f-89c8-4e1c-9601-6b5f191f7161 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.594998 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d3f3f-89c8-4e1c-9601-6b5f191f7161 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.610460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d3f3f-89c8-4e1c-9601-6b5f191f7161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f93d3f3f-89c8-4e1c-9601-6b5f191f7161 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:54.616985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:54.618303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:54.619336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:54.628072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 199/422] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:54.633990 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d3f3f-89c8-4e1c-9601-6b5f191f7161 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.789897 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98faa33-5fd5-4aed-bb8d-29f20e7e7e02 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.844740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d3f3f-89c8-4e1c-9601-6b5f191f7161 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.848157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.872056 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311a87-88bd-4514-93f4-91f2335838a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.872944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311a87-88bd-4514-93f4-91f2335838a7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.873448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311a87-88bd-4514-93f4-91f2335838a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.873932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311a87-88bd-4514-93f4-91f2335838a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.951524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3311a87-88bd-4514-93f4-91f2335838a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.953525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3311a87-88bd-4514-93f4-91f2335838a7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.973174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1871cb-09b9-484a-b0a7-4e042a98082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.973806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1871cb-09b9-484a-b0a7-4e042a98082c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.974092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1871cb-09b9-484a-b0a7-4e042a98082c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.974369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1871cb-09b9-484a-b0a7-4e042a98082c None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.975074 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1871cb-09b9-484a-b0a7-4e042a98082c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:54.975383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1871cb-09b9-484a-b0a7-4e042a98082c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.976775 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1871cb-09b9-484a-b0a7-4e042a98082c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.999746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 200/423] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.004992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1871cb-09b9-484a-b0a7-4e042a98082c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.094560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.111257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 224/424] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:55.112790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311a87-88bd-4514-93f4-91f2335838a7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.142510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.213473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1871cb-09b9-484a-b0a7-4e042a98082c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.232831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311a87-88bd-4514-93f4-91f2335838a7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.251122 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddede31-b25f-4281-8643-5b9a623bd1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.251748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddede31-b25f-4281-8643-5b9a623bd1ad None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.252029 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddede31-b25f-4281-8643-5b9a623bd1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.252303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddede31-b25f-4281-8643-5b9a623bd1ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.278759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd011ce-5ba4-4a5e-a543-9a474b970761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.279935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd011ce-5ba4-4a5e-a543-9a474b970761 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.280742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd011ce-5ba4-4a5e-a543-9a474b970761 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.281500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd011ce-5ba4-4a5e-a543-9a474b970761 None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.283392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd011ce-5ba4-4a5e-a543-9a474b970761 None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.285405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd011ce-5ba4-4a5e-a543-9a474b970761 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.288680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 225/425] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.290140 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce872fe8-e6ac-4c6e-87b5-821d2b08f754 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.290648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce872fe8-e6ac-4c6e-87b5-821d2b08f754 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.291156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce872fe8-e6ac-4c6e-87b5-821d2b08f754 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.294061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 226/426] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:55.295412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce872fe8-e6ac-4c6e-87b5-821d2b08f754 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.337139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddede31-b25f-4281-8643-5b9a623bd1ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.340343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddede31-b25f-4281-8643-5b9a623bd1ad None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.386507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.403318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.413539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce872fe8-e6ac-4c6e-87b5-821d2b08f754 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.452501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb4207-da08-44de-aa11-fdcd1a0c9b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.453127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4207-da08-44de-aa11-fdcd1a0c9b18 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.453411 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4207-da08-44de-aa11-fdcd1a0c9b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.453682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb4207-da08-44de-aa11-fdcd1a0c9b18 None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.454798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb4207-da08-44de-aa11-fdcd1a0c9b18 None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.456311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb4207-da08-44de-aa11-fdcd1a0c9b18 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.458056 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 227/427] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.459140 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53437e43-c411-47c9-a309-fa439571acc6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.459424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53437e43-c411-47c9-a309-fa439571acc6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.459689 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53437e43-c411-47c9-a309-fa439571acc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.469492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 201/428] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:55.470947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee50f-01e3-4572-a514-de3c385cbdbe None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.471492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee50f-01e3-4572-a514-de3c385cbdbe None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.471926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee50f-01e3-4572-a514-de3c385cbdbe None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.473344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 202/429] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:55.474471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ee50f-01e3-4572-a514-de3c385cbdbe None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.483395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-53437e43-c411-47c9-a309-fa439571acc6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:55.484582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-53437e43-c411-47c9-a309-fa439571acc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:55.558060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 228/430] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:55.563972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53437e43-c411-47c9-a309-fa439571acc6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.593780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ee50f-01e3-4572-a514-de3c385cbdbe None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.630549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.638077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db435b-1a87-4234-916f-e9f0a177cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.639187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db435b-1a87-4234-916f-e9f0a177cbda None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.639616 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db435b-1a87-4234-916f-e9f0a177cbda None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.640186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db435b-1a87-4234-916f-e9f0a177cbda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.641851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db435b-1a87-4234-916f-e9f0a177cbda None admin] RBAC: Adding query filter params (group.id=1a4c565b99c0477993d55a8c6e4c5cfb, role.id=8689bf0d70184aef9148c6b4a9758b32, scope.project.id=680354d08b5e4597b80901494f3d923c) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:55.642332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db435b-1a87-4234-916f-e9f0a177cbda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db435b-1a87-4234-916f-e9f0a177cbda None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.652638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 203/431] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/role_assignments?group.id=1a4c565b99c0477993d55a8c6e4c5cfb&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.654243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c997-0dc5-4a8a-a6a9-a3b8b0f5fd84 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.654679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c997-0dc5-4a8a-a6a9-a3b8b0f5fd84 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.655510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c997-0dc5-4a8a-a6a9-a3b8b0f5fd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.665339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.677070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53437e43-c411-47c9-a309-fa439571acc6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.678277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1ef4c997-0dc5-4a8a-a6a9-a3b8b0f5fd84 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:55.680964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1ef4c997-0dc5-4a8a-a6a9-a3b8b0f5fd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:55.729113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e9911-625c-47a7-9c20-75a42a5bf94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.730892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9911-625c-47a7-9c20-75a42a5bf94c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.731372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9911-625c-47a7-9c20-75a42a5bf94c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.733089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9911-625c-47a7-9c20-75a42a5bf94c None admin] PATH_INFO: `/v3/projects/680354d08b5e4597b80901494f3d923c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.734601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e9911-625c-47a7-9c20-75a42a5bf94c None admin] RBAC: Authorizing `identity:get_project(project_id=680354d08b5e4597b80901494f3d923c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.736296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e9911-625c-47a7-9c20-75a42a5bf94c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.738188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 229/432] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/projects/680354d08b5e4597b80901494f3d923c => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.740380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0bed3-ac18-4be0-a3cb-bfe78cfed49c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.740874 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0bed3-ac18-4be0-a3cb-bfe78cfed49c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.741295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0bed3-ac18-4be0-a3cb-bfe78cfed49c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.747829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 230/433] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:26:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:55.748579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0bed3-ac18-4be0-a3cb-bfe78cfed49c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.779217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 204/434] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:55.780751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274145d2-f0db-438c-b820-f25222a8eeb7 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.781039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274145d2-f0db-438c-b820-f25222a8eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.781314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274145d2-f0db-438c-b820-f25222a8eeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.817125 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-274145d2-f0db-438c-b820-f25222a8eeb7 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:55.818328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-274145d2-f0db-438c-b820-f25222a8eeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:55.894769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0bed3-ac18-4be0-a3cb-bfe78cfed49c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.927411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 205/435] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:55.928500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274145d2-f0db-438c-b820-f25222a8eeb7 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.937052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd28a9-af46-4566-b190-2264eec8ccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.937837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd28a9-af46-4566-b190-2264eec8ccb5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.938252 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd28a9-af46-4566-b190-2264eec8ccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.939613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd28a9-af46-4566-b190-2264eec8ccb5 None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.940496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd28a9-af46-4566-b190-2264eec8ccb5 None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.942526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd28a9-af46-4566-b190-2264eec8ccb5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.945015 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 231/436] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.950360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd28a9-af46-4566-b190-2264eec8ccb5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.994798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.005444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.058577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274145d2-f0db-438c-b820-f25222a8eeb7 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.086226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd28a9-af46-4566-b190-2264eec8ccb5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.110190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa298-2029-49e9-95ca-e999ce708d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.110838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa298-2029-49e9-95ca-e999ce708d5f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.111159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa298-2029-49e9-95ca-e999ce708d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.111445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa298-2029-49e9-95ca-e999ce708d5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.125431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fa298-2029-49e9-95ca-e999ce708d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-a32fa298-2029-49e9-95ca-e999ce708d5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:56.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:56.131285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:56.132220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 206/437] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:56.132935 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa298-2029-49e9-95ca-e999ce708d5f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.142910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baa4ba-fad1-41c5-b4e2-f7d19dbd72cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.143575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baa4ba-fad1-41c5-b4e2-f7d19dbd72cb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.143858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baa4ba-fad1-41c5-b4e2-f7d19dbd72cb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.144123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baa4ba-fad1-41c5-b4e2-f7d19dbd72cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.145501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50baa4ba-fad1-41c5-b4e2-f7d19dbd72cb None admin] RBAC: Adding query filter params (group.id=1a4c565b99c0477993d55a8c6e4c5cfb, role.id=0abc70600d6f4948a59e9a14d33aa289, scope.project.id=680354d08b5e4597b80901494f3d923c) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:56.145761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50baa4ba-fad1-41c5-b4e2-f7d19dbd72cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.147974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50baa4ba-fad1-41c5-b4e2-f7d19dbd72cb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.155271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 232/438] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/role_assignments?group.id=1a4c565b99c0477993d55a8c6e4c5cfb&scope.project.id=680354d08b5e4597b80901494f3d923c&role.id=0abc70600d6f4948a59e9a14d33aa289 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:56.159190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baa4ba-fad1-41c5-b4e2-f7d19dbd72cb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.257290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa298-2029-49e9-95ca-e999ce708d5f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.274516 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.277846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.289658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baa4ba-fad1-41c5-b4e2-f7d19dbd72cb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.312922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff4dd-fd99-4007-9d30-c070a135956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.314415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff4dd-fd99-4007-9d30-c070a135956f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.314696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff4dd-fd99-4007-9d30-c070a135956f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.315190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff4dd-fd99-4007-9d30-c070a135956f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.329017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff4dd-fd99-4007-9d30-c070a135956f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:56.334598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f9d4e-fa97-46af-994f-6ea102f15fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.334598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f9d4e-fa97-46af-994f-6ea102f15fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-22dff4dd-fd99-4007-9d30-c070a135956f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:56.334832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:56.335666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:56.336732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:56.337724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f9d4e-fa97-46af-994f-6ea102f15fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.337724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f9d4e-fa97-46af-994f-6ea102f15fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.337842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 207/439] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:56.338310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff4dd-fd99-4007-9d30-c070a135956f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.340954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f9d4e-fa97-46af-994f-6ea102f15fe6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:56.341927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f9d4e-fa97-46af-994f-6ea102f15fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.344597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f9d4e-fa97-46af-994f-6ea102f15fe6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.359791 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 233/440] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:56.359791 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f9d4e-fa97-46af-994f-6ea102f15fe6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.458499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff4dd-fd99-4007-9d30-c070a135956f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.488025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f9d4e-fa97-46af-994f-6ea102f15fe6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.497753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599d14b-5af8-4822-98f8-f224b7e075bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.498398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599d14b-5af8-4822-98f8-f224b7e075bb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.498682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599d14b-5af8-4822-98f8-f224b7e075bb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.499977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599d14b-5af8-4822-98f8-f224b7e075bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.513706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599d14b-5af8-4822-98f8-f224b7e075bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-a599d14b-5af8-4822-98f8-f224b7e075bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:56.518790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:56.519920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:26:56.520717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 208/441] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:56.521394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599d14b-5af8-4822-98f8-f224b7e075bb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.531603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7648b94-c563-4dca-bd0a-be75036119f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.532228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7648b94-c563-4dca-bd0a-be75036119f4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.532514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7648b94-c563-4dca-bd0a-be75036119f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.532796 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7648b94-c563-4dca-bd0a-be75036119f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.533586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7648b94-c563-4dca-bd0a-be75036119f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:56.533899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7648b94-c563-4dca-bd0a-be75036119f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.537977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7648b94-c563-4dca-bd0a-be75036119f4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.546851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 234/442] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:56.547665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7648b94-c563-4dca-bd0a-be75036119f4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.562214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.565213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.627550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599d14b-5af8-4822-98f8-f224b7e075bb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.647667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7648b94-c563-4dca-bd0a-be75036119f4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.660903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe464511-250d-435a-b763-d4f8e918470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.661515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe464511-250d-435a-b763-d4f8e918470c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.661796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe464511-250d-435a-b763-d4f8e918470c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.662069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe464511-250d-435a-b763-d4f8e918470c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.681732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b39ca-7959-49fa-95ab-b84135cf9ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.682336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b39ca-7959-49fa-95ab-b84135cf9ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.683182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b39ca-7959-49fa-95ab-b84135cf9ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.683458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b39ca-7959-49fa-95ab-b84135cf9ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.684129 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b39ca-7959-49fa-95ab-b84135cf9ab6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:56.684432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b39ca-7959-49fa-95ab-b84135cf9ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.685810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b39ca-7959-49fa-95ab-b84135cf9ab6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.693888 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 235/443] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:56.694665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b39ca-7959-49fa-95ab-b84135cf9ab6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.729230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe464511-250d-435a-b763-d4f8e918470c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.731205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe464511-250d-435a-b763-d4f8e918470c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.764323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.784992 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.808355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b39ca-7959-49fa-95ab-b84135cf9ab6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.829689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 209/444] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:56.830670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe464511-250d-435a-b763-d4f8e918470c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.844340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86642bc-93c8-4448-b7af-16c03a41bc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.844966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86642bc-93c8-4448-b7af-16c03a41bc8c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.845250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86642bc-93c8-4448-b7af-16c03a41bc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.845532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86642bc-93c8-4448-b7af-16c03a41bc8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.917509 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86642bc-93c8-4448-b7af-16c03a41bc8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.918982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86642bc-93c8-4448-b7af-16c03a41bc8c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.929911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe464511-250d-435a-b763-d4f8e918470c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.969183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e83f8-78f8-48ef-b679-9ed44c3eaf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.969794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e83f8-78f8-48ef-b679-9ed44c3eaf27 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.970073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e83f8-78f8-48ef-b679-9ed44c3eaf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.970342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e83f8-78f8-48ef-b679-9ed44c3eaf27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.973039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.004424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.032854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 236/445] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:57.032854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86642bc-93c8-4448-b7af-16c03a41bc8c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.044422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e83f8-78f8-48ef-b679-9ed44c3eaf27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.046322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e83f8-78f8-48ef-b679-9ed44c3eaf27 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.127363 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86642bc-93c8-4448-b7af-16c03a41bc8c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.145807 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 210/446] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:57.146648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e83f8-78f8-48ef-b679-9ed44c3eaf27 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.165367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362443f5-d854-4b20-a5b6-791a409ae67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.165997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362443f5-d854-4b20-a5b6-791a409ae67e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.166278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362443f5-d854-4b20-a5b6-791a409ae67e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.166549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362443f5-d854-4b20-a5b6-791a409ae67e None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.167755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362443f5-d854-4b20-a5b6-791a409ae67e None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.169250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362443f5-d854-4b20-a5b6-791a409ae67e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.170882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 237/447] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.171665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362443f5-d854-4b20-a5b6-791a409ae67e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.179241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.220793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.251873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e83f8-78f8-48ef-b679-9ed44c3eaf27 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.274258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362443f5-d854-4b20-a5b6-791a409ae67e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.285711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6563ce-9b3e-4889-83b7-87a6f6931d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.286345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6563ce-9b3e-4889-83b7-87a6f6931d9f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.286625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6563ce-9b3e-4889-83b7-87a6f6931d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.286899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6563ce-9b3e-4889-83b7-87a6f6931d9f None admin] PATH_INFO: `/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.288088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6563ce-9b3e-4889-83b7-87a6f6931d9f None admin] RBAC: Authorizing `identity:get_project(project_id=ce37eeb36b8d44b0ae5c523d52045e8b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.289531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6563ce-9b3e-4889-83b7-87a6f6931d9f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.291213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 211/448] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/projects/ce37eeb36b8d44b0ae5c523d52045e8b => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.292522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6563ce-9b3e-4889-83b7-87a6f6931d9f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.318518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a5687-316f-4286-86f8-a558118c268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.319211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a5687-316f-4286-86f8-a558118c268b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.319490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a5687-316f-4286-86f8-a558118c268b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.319758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a5687-316f-4286-86f8-a558118c268b None admin] PATH_INFO: `/v3/projects/8ee2c938bc0d4468aba227f5962adcb7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.321528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a5687-316f-4286-86f8-a558118c268b None admin] RBAC: Authorizing `identity:get_project(project_id=8ee2c938bc0d4468aba227f5962adcb7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.323331 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a5687-316f-4286-86f8-a558118c268b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.325118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 238/449] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/projects/8ee2c938bc0d4468aba227f5962adcb7 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.326492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a5687-316f-4286-86f8-a558118c268b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.401518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6563ce-9b3e-4889-83b7-87a6f6931d9f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.403081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.426019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a5687-316f-4286-86f8-a558118c268b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.436126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e509d4f-17b5-4be7-ba6c-9aa46f89ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.436756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e509d4f-17b5-4be7-ba6c-9aa46f89ba4d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.437038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e509d4f-17b5-4be7-ba6c-9aa46f89ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.437310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e509d4f-17b5-4be7-ba6c-9aa46f89ba4d None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.438425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e509d4f-17b5-4be7-ba6c-9aa46f89ba4d None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.439597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.439889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e509d4f-17b5-4be7-ba6c-9aa46f89ba4d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.446195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 212/450] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.446195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e509d4f-17b5-4be7-ba6c-9aa46f89ba4d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.465664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c47de-8e5c-40a2-9563-070985f0b381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.466297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c47de-8e5c-40a2-9563-070985f0b381 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.466573 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c47de-8e5c-40a2-9563-070985f0b381 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.466842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c47de-8e5c-40a2-9563-070985f0b381 None admin] PATH_INFO: `/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.468039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c47de-8e5c-40a2-9563-070985f0b381 None admin] RBAC: Authorizing `identity:get_group(group_id=1a4c565b99c0477993d55a8c6e4c5cfb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.469823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c47de-8e5c-40a2-9563-070985f0b381 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.471789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 239/451] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/groups/1a4c565b99c0477993d55a8c6e4c5cfb => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.472890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c47de-8e5c-40a2-9563-070985f0b381 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.545073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e509d4f-17b5-4be7-ba6c-9aa46f89ba4d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.570364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c47de-8e5c-40a2-9563-070985f0b381 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.578201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200448b7-3508-4837-84a2-3d0d3bb644a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.578827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200448b7-3508-4837-84a2-3d0d3bb644a1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.579134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200448b7-3508-4837-84a2-3d0d3bb644a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.579413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200448b7-3508-4837-84a2-3d0d3bb644a1 None admin] PATH_INFO: `/v3/groups/d5980bf7e3744520849a2339d4568989` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.580611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200448b7-3508-4837-84a2-3d0d3bb644a1 None admin] RBAC: Authorizing `identity:get_group(group_id=d5980bf7e3744520849a2339d4568989)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.581997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200448b7-3508-4837-84a2-3d0d3bb644a1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.583589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 213/452] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/groups/d5980bf7e3744520849a2339d4568989 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.584352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200448b7-3508-4837-84a2-3d0d3bb644a1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.605889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b1546-0d54-4bf2-b089-ce42716bc08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.606495 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1546-0d54-4bf2-b089-ce42716bc08c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.606778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1546-0d54-4bf2-b089-ce42716bc08c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.607326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1546-0d54-4bf2-b089-ce42716bc08c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.608060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b1546-0d54-4bf2-b089-ce42716bc08c None admin] RBAC: Adding query filter params (group.id=1a4c565b99c0477993d55a8c6e4c5cfb, role.id=0abc70600d6f4948a59e9a14d33aa289, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:57.608373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b1546-0d54-4bf2-b089-ce42716bc08c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.609853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b1546-0d54-4bf2-b089-ce42716bc08c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.617127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 240/453] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/role_assignments?group.id=1a4c565b99c0477993d55a8c6e4c5cfb&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=0abc70600d6f4948a59e9a14d33aa289 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.617947 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b1546-0d54-4bf2-b089-ce42716bc08c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.634298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.673392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.712376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200448b7-3508-4837-84a2-3d0d3bb644a1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.739160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b1546-0d54-4bf2-b089-ce42716bc08c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.755094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fcd3e-35b2-40ce-97a6-9954ff8465e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.755740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fcd3e-35b2-40ce-97a6-9954ff8465e1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.756022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fcd3e-35b2-40ce-97a6-9954ff8465e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.756303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fcd3e-35b2-40ce-97a6-9954ff8465e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.757053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fcd3e-35b2-40ce-97a6-9954ff8465e1 None admin] RBAC: Adding query filter params (group.id=1a4c565b99c0477993d55a8c6e4c5cfb, role.id=8689bf0d70184aef9148c6b4a9758b32, scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:57.757368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fcd3e-35b2-40ce-97a6-9954ff8465e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.758843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fcd3e-35b2-40ce-97a6-9954ff8465e1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.766101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 214/454] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/role_assignments?group.id=1a4c565b99c0477993d55a8c6e4c5cfb&scope.project.id=ce37eeb36b8d44b0ae5c523d52045e8b&role.id=8689bf0d70184aef9148c6b4a9758b32 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.779495 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33e0a1-5b16-4829-820b-d3302d4537b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.780128 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e0a1-5b16-4829-820b-d3302d4537b9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.780416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e0a1-5b16-4829-820b-d3302d4537b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.780694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e0a1-5b16-4829-820b-d3302d4537b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.782217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33e0a1-5b16-4829-820b-d3302d4537b9 None admin] RBAC: Adding query filter params (group.id=d5980bf7e3744520849a2339d4568989, role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=8ee2c938bc0d4468aba227f5962adcb7) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:57.782217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33e0a1-5b16-4829-820b-d3302d4537b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.783482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33e0a1-5b16-4829-820b-d3302d4537b9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.790295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 241/455] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/role_assignments?group.id=d5980bf7e3744520849a2339d4568989&scope.project.id=8ee2c938bc0d4468aba227f5962adcb7&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:00.556707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ed15-a36b-40fb-acb1-80e43f54cf3d None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.557320 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ed15-a36b-40fb-acb1-80e43f54cf3d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.557320 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ed15-a36b-40fb-acb1-80e43f54cf3d None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.558920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 215/456] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:00.572651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662670-3a1f-4ddf-b3b8-2a17931c9e88 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.573661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662670-3a1f-4ddf-b3b8-2a17931c9e88 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.573760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662670-3a1f-4ddf-b3b8-2a17931c9e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.599346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8b662670-3a1f-4ddf-b3b8-2a17931c9e88 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:00.600423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cf236-d9a8-49ba-8f94-de0459a0efbc None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.600534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8b662670-3a1f-4ddf-b3b8-2a17931c9e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:00.601007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cf236-d9a8-49ba-8f94-de0459a0efbc None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.601500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cf236-d9a8-49ba-8f94-de0459a0efbc None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.603331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 216/457] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:00.610047 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc70b4e-c350-4800-b1f3-845a3290fa7a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.610349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc70b4e-c350-4800-b1f3-845a3290fa7a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.610630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc70b4e-c350-4800-b1f3-845a3290fa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.642693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6cc70b4e-c350-4800-b1f3-845a3290fa7a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:00.645780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6cc70b4e-c350-4800-b1f3-845a3290fa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:00.708723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 242/458] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:00.748263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 217/459] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:00.748450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a03cd-6e1e-4c74-a8aa-fe7fa014efe0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.748675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a03cd-6e1e-4c74-a8aa-fe7fa014efe0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.748952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a03cd-6e1e-4c74-a8aa-fe7fa014efe0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.750471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 243/460] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:00.768707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b4585-4cf1-4a67-a53b-53134ececbce None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.769002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b4585-4cf1-4a67-a53b-53134ececbce None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.769268 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b4585-4cf1-4a67-a53b-53134ececbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.795478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b85b4585-4cf1-4a67-a53b-53134ececbce None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:00.796786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b85b4585-4cf1-4a67-a53b-53134ececbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:00.825012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.880589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 218/461] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:00.988054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a03cd-6e1e-4c74-a8aa-fe7fa014efe0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.037559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.073986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b4585-4cf1-4a67-a53b-53134ececbce None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.134639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a03cd-6e1e-4c74-a8aa-fe7fa014efe0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.191435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca96066-558f-447c-b640-642101b67af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.192720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca96066-558f-447c-b640-642101b67af7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.193379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca96066-558f-447c-b640-642101b67af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.193855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca96066-558f-447c-b640-642101b67af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.206097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca96066-558f-447c-b640-642101b67af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.207956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca96066-558f-447c-b640-642101b67af7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7ca96066-558f-447c-b640-642101b67af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:01.226725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:01.227776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:01.228630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:01.228630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:01.228630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:01.231443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 244/462] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:01.232677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca96066-558f-447c-b640-642101b67af7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.255321 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b4585-4cf1-4a67-a53b-53134ececbce None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.293352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3a6c6-1636-41be-9c94-45d13f4f60c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.294486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3a6c6-1636-41be-9c94-45d13f4f60c1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.294486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3a6c6-1636-41be-9c94-45d13f4f60c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.294853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3a6c6-1636-41be-9c94-45d13f4f60c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.305970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3a6c6-1636-41be-9c94-45d13f4f60c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.307696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3a6c6-1636-41be-9c94-45d13f4f60c1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-ddc3a6c6-1636-41be-9c94-45d13f4f60c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:01.323996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:01.325137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:01.326192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:01.326192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:01.326192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:01.327417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 219/463] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:01.328368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3a6c6-1636-41be-9c94-45d13f4f60c1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.345048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.353948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.368072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca96066-558f-447c-b640-642101b67af7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.411081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563cb74-38e5-46f9-baa7-5568066fc0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.411651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563cb74-38e5-46f9-baa7-5568066fc0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.411934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563cb74-38e5-46f9-baa7-5568066fc0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.412213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563cb74-38e5-46f9-baa7-5568066fc0b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.423592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563cb74-38e5-46f9-baa7-5568066fc0b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.425096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563cb74-38e5-46f9-baa7-5568066fc0b4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4563cb74-38e5-46f9-baa7-5568066fc0b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:01.440537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:01.441659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:01.442516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:01.442516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:01.442516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:01.442516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 245/464] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:01.442864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563cb74-38e5-46f9-baa7-5568066fc0b4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.449565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3a6c6-1636-41be-9c94-45d13f4f60c1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.488710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e30a8-e113-41d0-9587-2673b3bcd1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.489313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e30a8-e113-41d0-9587-2673b3bcd1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.489593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e30a8-e113-41d0-9587-2673b3bcd1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.490033 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e30a8-e113-41d0-9587-2673b3bcd1b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.490515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e30a8-e113-41d0-9587-2673b3bcd1b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:01.490821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e30a8-e113-41d0-9587-2673b3bcd1b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.492232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e30a8-e113-41d0-9587-2673b3bcd1b2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.509433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 220/465] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:01.509433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70f58-966b-4ead-974f-7ec5d1c74432 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.509433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70f58-966b-4ead-974f-7ec5d1c74432 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.509433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70f58-966b-4ead-974f-7ec5d1c74432 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.511226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 221/466] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:01.511961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a70f58-966b-4ead-974f-7ec5d1c74432 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.558858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563cb74-38e5-46f9-baa7-5568066fc0b4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.594972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.596219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc074eb-5435-49f2-9d29-044c38ad0462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.596837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc074eb-5435-49f2-9d29-044c38ad0462 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.597122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc074eb-5435-49f2-9d29-044c38ad0462 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.597404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc074eb-5435-49f2-9d29-044c38ad0462 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.598069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc074eb-5435-49f2-9d29-044c38ad0462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:01.598374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc074eb-5435-49f2-9d29-044c38ad0462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.599885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc074eb-5435-49f2-9d29-044c38ad0462 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.621017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a70f58-966b-4ead-974f-7ec5d1c74432 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.622997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 246/467] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:01.623713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc074eb-5435-49f2-9d29-044c38ad0462 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.626479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.660668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5d166-3e8d-404d-aaf8-006ebe133a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.661334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d166-3e8d-404d-aaf8-006ebe133a22 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.661573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d166-3e8d-404d-aaf8-006ebe133a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.661850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d166-3e8d-404d-aaf8-006ebe133a22 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.662507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5d166-3e8d-404d-aaf8-006ebe133a22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:01.662815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5d166-3e8d-404d-aaf8-006ebe133a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.664259 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5d166-3e8d-404d-aaf8-006ebe133a22 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.677383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 222/468] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:01.678388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770419-9789-4ec8-83b6-986c7da5cb79 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.678678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770419-9789-4ec8-83b6-986c7da5cb79 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.678958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770419-9789-4ec8-83b6-986c7da5cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.697053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-90770419-9789-4ec8-83b6-986c7da5cb79 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:01.698292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-90770419-9789-4ec8-83b6-986c7da5cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:01.739869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc074eb-5435-49f2-9d29-044c38ad0462 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.770138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 223/469] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:01.772175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90770419-9789-4ec8-83b6-986c7da5cb79 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.778287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfc1d3-7a0b-4133-85e0-d692dfd1a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.779082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfc1d3-7a0b-4133-85e0-d692dfd1a38c None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.779526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfc1d3-7a0b-4133-85e0-d692dfd1a38c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.779918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfc1d3-7a0b-4133-85e0-d692dfd1a38c None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.780718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfc1d3-7a0b-4133-85e0-d692dfd1a38c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.782626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfc1d3-7a0b-4133-85e0-d692dfd1a38c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.844175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.875027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 247/470] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:27:01 2022] POST /identity/v3/users => generated 246 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:01.875959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfc1d3-7a0b-4133-85e0-d692dfd1a38c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.887931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90770419-9789-4ec8-83b6-986c7da5cb79 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.932547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd0b4d-6bc8-4ac6-974b-ca06052ba2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.933516 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0b4d-6bc8-4ac6-974b-ca06052ba2b5 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.934074 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0b4d-6bc8-4ac6-974b-ca06052ba2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.934574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0b4d-6bc8-4ac6-974b-ca06052ba2b5 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.935563 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd0b4d-6bc8-4ac6-974b-ca06052ba2b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.937337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd0b4d-6bc8-4ac6-974b-ca06052ba2b5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.958813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.012121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfc1d3-7a0b-4133-85e0-d692dfd1a38c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.020473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 224/471] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:27:01 2022] POST /identity/v3/users => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:02.023693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10400-907b-4d46-b308-72efd44ef6d7 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.024116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10400-907b-4d46-b308-72efd44ef6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.024453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10400-907b-4d46-b308-72efd44ef6d7 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.031102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 225/472] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:02.035506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675b1e3-4b8d-459d-aa60-fc639517075a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.035783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675b1e3-4b8d-459d-aa60-fc639517075a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.043822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675b1e3-4b8d-459d-aa60-fc639517075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.068344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a675b1e3-4b8d-459d-aa60-fc639517075a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:02.069622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a675b1e3-4b8d-459d-aa60-fc639517075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:02.083240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce596997-7e80-462c-a7bb-49836a82fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.083595 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce596997-7e80-462c-a7bb-49836a82fefa None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.083944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce596997-7e80-462c-a7bb-49836a82fefa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.085761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce596997-7e80-462c-a7bb-49836a82fefa None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.085761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce596997-7e80-462c-a7bb-49836a82fefa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.088297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce596997-7e80-462c-a7bb-49836a82fefa None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.160306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 226/473] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:02.161623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675b1e3-4b8d-459d-aa60-fc639517075a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.207078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 248/474] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:27:01 2022] POST /identity/v3/users => generated 248 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:02.224419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.286932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675b1e3-4b8d-459d-aa60-fc639517075a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.326976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7ae4d-0b42-40ec-9e73-819971b24a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.328078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7ae4d-0b42-40ec-9e73-819971b24a5f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.328556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7ae4d-0b42-40ec-9e73-819971b24a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.329026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7ae4d-0b42-40ec-9e73-819971b24a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.342487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7ae4d-0b42-40ec-9e73-819971b24a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.344464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7ae4d-0b42-40ec-9e73-819971b24a5f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-d2c7ae4d-0b42-40ec-9e73-819971b24a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:02.364605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:02.365547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:02.366377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:02.366377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:02.366377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:02.366377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 227/475] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:02.371664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce596997-7e80-462c-a7bb-49836a82fefa None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.485390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce596997-7e80-462c-a7bb-49836a82fefa None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.498555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7ae4d-0b42-40ec-9e73-819971b24a5f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.502079 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.525209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09395fe-317c-470b-a081-2b120140ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.526825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09395fe-317c-470b-a081-2b120140ff1e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.527355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09395fe-317c-470b-a081-2b120140ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.527824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09395fe-317c-470b-a081-2b120140ff1e None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.528766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09395fe-317c-470b-a081-2b120140ff1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:02.529655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09395fe-317c-470b-a081-2b120140ff1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.531690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09395fe-317c-470b-a081-2b120140ff1e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.548174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 249/476] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:02.554432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09395fe-317c-470b-a081-2b120140ff1e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.618630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7ae4d-0b42-40ec-9e73-819971b24a5f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.621071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.662477 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3cbd-31ac-4128-b618-0a74698b8660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.663258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3cbd-31ac-4128-b618-0a74698b8660 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.663613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3cbd-31ac-4128-b618-0a74698b8660 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.663959 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3cbd-31ac-4128-b618-0a74698b8660 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.664893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa3cbd-31ac-4128-b618-0a74698b8660 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.668337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa3cbd-31ac-4128-b618-0a74698b8660 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.685192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09395fe-317c-470b-a081-2b120140ff1e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.698526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.sql.core [None req-94fa3cbd-31ac-4128-b618-0a74698b8660 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:27:02.698526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 03:27:02.698526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [parameters: {'id': 'e86a307995294a7baac3ce3916a1baac', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 03:27:02.698526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81855) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-94fa3cbd-31ac-4128-b618-0a74698b8660 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:02.731467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:02.732811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application yield resource Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise self.value Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application session.commit() Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:27:02.733896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:27:02.734819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:02.735738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:02.736632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [parameters: {'id': 'e86a307995294a7baac3ce3916a1baac', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:02.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 03:27:02.738374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:02.741844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 228/477] 10.222.0.88 () {60 vars in 1131 bytes} [Wed Aug 24 03:27:02 2022] POST /identity/v3/roles => generated 144 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:02.748066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3cbd-31ac-4128-b618-0a74698b8660 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.764391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398b9c1-4ff7-4ffe-8124-1b90d022c4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.765257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398b9c1-4ff7-4ffe-8124-1b90d022c4b2 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.765714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398b9c1-4ff7-4ffe-8124-1b90d022c4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.766125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398b9c1-4ff7-4ffe-8124-1b90d022c4b2 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.766908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398b9c1-4ff7-4ffe-8124-1b90d022c4b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.768585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398b9c1-4ff7-4ffe-8124-1b90d022c4b2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.859601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 250/478] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:27:02 2022] POST /identity/v3/users => generated 249 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:02.895211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3cbd-31ac-4128-b618-0a74698b8660 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.938397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6ad77-dc1a-42f7-9965-6ec62a37792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.939068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6ad77-dc1a-42f7-9965-6ec62a37792d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.939354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6ad77-dc1a-42f7-9965-6ec62a37792d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.939636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6ad77-dc1a-42f7-9965-6ec62a37792d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.954803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6ad77-dc1a-42f7-9965-6ec62a37792d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-4aa6ad77-dc1a-42f7-9965-6ec62a37792d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:02.960178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:02.961040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:27:02.961862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:02.966608 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 229/479] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:02.967968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398b9c1-4ff7-4ffe-8124-1b90d022c4b2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.012773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.125844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398b9c1-4ff7-4ffe-8124-1b90d022c4b2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.168514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314add4c-7065-4c38-9e2a-a3933f7fedb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.169289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314add4c-7065-4c38-9e2a-a3933f7fedb6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.169577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314add4c-7065-4c38-9e2a-a3933f7fedb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.169854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314add4c-7065-4c38-9e2a-a3933f7fedb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.170538 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314add4c-7065-4c38-9e2a-a3933f7fedb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:03.170845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314add4c-7065-4c38-9e2a-a3933f7fedb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.172269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314add4c-7065-4c38-9e2a-a3933f7fedb6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.187200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 251/480] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:04.146243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5611c0-4129-4b55-b8de-82f4031ca2f0 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.146735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5611c0-4129-4b55-b8de-82f4031ca2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.146735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5611c0-4129-4b55-b8de-82f4031ca2f0 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.148361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 230/481] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:04.154669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc129230-ca3e-467a-804a-99e7aa654464 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.155119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc129230-ca3e-467a-804a-99e7aa654464 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.155287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc129230-ca3e-467a-804a-99e7aa654464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.179991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cc129230-ca3e-467a-804a-99e7aa654464 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:04.181193 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc129230-ca3e-467a-804a-99e7aa654464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:04.272724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 252/482] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:04.397046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f3183-c205-407f-918e-063d59f0f8bb None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.397671 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f3183-c205-407f-918e-063d59f0f8bb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.398141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f3183-c205-407f-918e-063d59f0f8bb None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.400603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 231/483] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:04.406309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9ca2-9237-4f2e-82cc-f5b7c202ea6e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.406600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9ca2-9237-4f2e-82cc-f5b7c202ea6e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.406879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9ca2-9237-4f2e-82cc-f5b7c202ea6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.429714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2d7a9ca2-9237-4f2e-82cc-f5b7c202ea6e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:04.430922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d7a9ca2-9237-4f2e-82cc-f5b7c202ea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:04.448678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.521763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 253/484] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:04.699432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f3183-c205-407f-918e-063d59f0f8bb None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.716376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c49f-85d5-4247-baa1-e059a8fb7bf2 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.716671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c49f-85d5-4247-baa1-e059a8fb7bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.716924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c49f-85d5-4247-baa1-e059a8fb7bf2 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.718529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 254/485] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:04.723560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37493b60-2143-41e3-885f-4edf958a1a45 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.723845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37493b60-2143-41e3-885f-4edf958a1a45 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.724124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37493b60-2143-41e3-885f-4edf958a1a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.733702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.746676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-37493b60-2143-41e3-885f-4edf958a1a45 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:04.749019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37493b60-2143-41e3-885f-4edf958a1a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:04.865848 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f3183-c205-407f-918e-063d59f0f8bb None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.871592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 255/486] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:27:04.899351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37493b60-2143-41e3-885f-4edf958a1a45 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.942723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e652-8321-4b50-baa9-e34599374628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.943391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e652-8321-4b50-baa9-e34599374628 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.943679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e652-8321-4b50-baa9-e34599374628 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.943955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e652-8321-4b50-baa9-e34599374628 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.968826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85e652-8321-4b50-baa9-e34599374628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-0a85e652-8321-4b50-baa9-e34599374628 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:04.973647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:04.974707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:04.975705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:04.984914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 232/487] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:04.985865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e652-8321-4b50-baa9-e34599374628 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.033241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.068170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37493b60-2143-41e3-885f-4edf958a1a45 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.140698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727c604-3e28-4190-b1f0-de93aa6d1193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.141471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727c604-3e28-4190-b1f0-de93aa6d1193 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.141819 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727c604-3e28-4190-b1f0-de93aa6d1193 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.142188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727c604-3e28-4190-b1f0-de93aa6d1193 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.167236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.168264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727c604-3e28-4190-b1f0-de93aa6d1193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a727c604-3e28-4190-b1f0-de93aa6d1193 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:05.179146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:05.181226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:05.183185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:05.184631 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 256/488] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:05.190290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727c604-3e28-4190-b1f0-de93aa6d1193 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.197848 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e652-8321-4b50-baa9-e34599374628 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.242907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fdcca-acca-48bd-97a2-5e8ea358dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.243495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fdcca-acca-48bd-97a2-5e8ea358dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.243768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fdcca-acca-48bd-97a2-5e8ea358dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.244041 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fdcca-acca-48bd-97a2-5e8ea358dcd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.245590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fdcca-acca-48bd-97a2-5e8ea358dcd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.245898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fdcca-acca-48bd-97a2-5e8ea358dcd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.247931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fdcca-acca-48bd-97a2-5e8ea358dcd0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.258397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 233/489] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.259553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fdcca-acca-48bd-97a2-5e8ea358dcd0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.323646 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727c604-3e28-4190-b1f0-de93aa6d1193 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.371998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48befccd-cb30-415b-8dec-87a7c787076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.373154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48befccd-cb30-415b-8dec-87a7c787076c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.373435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48befccd-cb30-415b-8dec-87a7c787076c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.374044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48befccd-cb30-415b-8dec-87a7c787076c None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.374724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48befccd-cb30-415b-8dec-87a7c787076c None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.375334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48befccd-cb30-415b-8dec-87a7c787076c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.377478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48befccd-cb30-415b-8dec-87a7c787076c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.386170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fdcca-acca-48bd-97a2-5e8ea358dcd0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.390087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 257/490] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.390949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48befccd-cb30-415b-8dec-87a7c787076c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.395076 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.427738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102b7f8-359d-45b1-a077-24fb8594062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.428557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102b7f8-359d-45b1-a077-24fb8594062f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.428837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102b7f8-359d-45b1-a077-24fb8594062f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.429111 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102b7f8-359d-45b1-a077-24fb8594062f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.442663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102b7f8-359d-45b1-a077-24fb8594062f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-a102b7f8-359d-45b1-a077-24fb8594062f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:05.449246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:05.451329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 234/491] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:05.453206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102b7f8-359d-45b1-a077-24fb8594062f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.468914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.522286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48befccd-cb30-415b-8dec-87a7c787076c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.557728 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fd1d8-758b-4ef0-95ee-a8c5df74011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.558356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fd1d8-758b-4ef0-95ee-a8c5df74011e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.558639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fd1d8-758b-4ef0-95ee-a8c5df74011e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.558916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fd1d8-758b-4ef0-95ee-a8c5df74011e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.567571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102b7f8-359d-45b1-a077-24fb8594062f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.570301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fd1d8-758b-4ef0-95ee-a8c5df74011e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.571901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fd1d8-758b-4ef0-95ee-a8c5df74011e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-3c6fd1d8-758b-4ef0-95ee-a8c5df74011e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:05.586501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:05.587486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:05.588613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:05.588613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:05.588613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:05.588613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 258/492] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:05.589371 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fd1d8-758b-4ef0-95ee-a8c5df74011e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.608909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6fbbe-ea0e-46a3-9861-f8efb5ba48d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.609536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6fbbe-ea0e-46a3-9861-f8efb5ba48d0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.609815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6fbbe-ea0e-46a3-9861-f8efb5ba48d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.610086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6fbbe-ea0e-46a3-9861-f8efb5ba48d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.621489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6fbbe-ea0e-46a3-9861-f8efb5ba48d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.622947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6fbbe-ea0e-46a3-9861-f8efb5ba48d0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-03c6fbbe-ea0e-46a3-9861-f8efb5ba48d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:05.639137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:05.640141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:05.640981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:05.640981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:05.640981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:05.640981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 235/493] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:05.641660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1824c4-e38f-46b4-8b6f-d4780f5708a7 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.641660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1824c4-e38f-46b4-8b6f-d4780f5708a7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.641931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1824c4-e38f-46b4-8b6f-d4780f5708a7 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.643433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 236/494] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:05.647796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1824c4-e38f-46b4-8b6f-d4780f5708a7 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.652539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.698658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fd1d8-758b-4ef0-95ee-a8c5df74011e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.715196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.733287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ae501-5a8e-4fa9-89aa-c57e09b305dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.734062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ae501-5a8e-4fa9-89aa-c57e09b305dd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.734346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ae501-5a8e-4fa9-89aa-c57e09b305dd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.734619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ae501-5a8e-4fa9-89aa-c57e09b305dd None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.735331 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ae501-5a8e-4fa9-89aa-c57e09b305dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.735633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ae501-5a8e-4fa9-89aa-c57e09b305dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.737081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ae501-5a8e-4fa9-89aa-c57e09b305dd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.745740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 259/495] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.746612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ae501-5a8e-4fa9-89aa-c57e09b305dd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.761391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1824c4-e38f-46b4-8b6f-d4780f5708a7 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.795285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6f375-e36c-4fa1-905f-ed7cb4cbdb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.795799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6f375-e36c-4fa1-905f-ed7cb4cbdb46 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.796102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6f375-e36c-4fa1-905f-ed7cb4cbdb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.796373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6f375-e36c-4fa1-905f-ed7cb4cbdb46 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.797006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6f375-e36c-4fa1-905f-ed7cb4cbdb46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.797306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6f375-e36c-4fa1-905f-ed7cb4cbdb46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.798788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6f375-e36c-4fa1-905f-ed7cb4cbdb46 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.810376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 237/496] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.811565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d6918-7ead-4243-91d1-98027fca942d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.811846 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d6918-7ead-4243-91d1-98027fca942d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.812116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d6918-7ead-4243-91d1-98027fca942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.831094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0f3d6918-7ead-4243-91d1-98027fca942d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:05.832324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0f3d6918-7ead-4243-91d1-98027fca942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:05.848679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ae501-5a8e-4fa9-89aa-c57e09b305dd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.866260 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.883208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a8460-3dbd-46ae-a12f-c46242e34387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.883814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a8460-3dbd-46ae-a12f-c46242e34387 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.884096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a8460-3dbd-46ae-a12f-c46242e34387 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.884369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a8460-3dbd-46ae-a12f-c46242e34387 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.885007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a8460-3dbd-46ae-a12f-c46242e34387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.885330 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a8460-3dbd-46ae-a12f-c46242e34387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.886724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a8460-3dbd-46ae-a12f-c46242e34387 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.898484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 260/497] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.899663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ba07a-a482-41d6-842d-4991dcf7cd14 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.899942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ba07a-a482-41d6-842d-4991dcf7cd14 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.900215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ba07a-a482-41d6-842d-4991dcf7cd14 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.901909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 261/498] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:05.903174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ba07a-a482-41d6-842d-4991dcf7cd14 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.907492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 238/499] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:05.908338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d6918-7ead-4243-91d1-98027fca942d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.959709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.011898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d6918-7ead-4243-91d1-98027fca942d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.015475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ba07a-a482-41d6-842d-4991dcf7cd14 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.046685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a0c1b-3458-451b-b6f2-3d532fbe52bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.047278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a0c1b-3458-451b-b6f2-3d532fbe52bb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.047557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a0c1b-3458-451b-b6f2-3d532fbe52bb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.047832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a0c1b-3458-451b-b6f2-3d532fbe52bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.052138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d967f4-0e39-4f8e-8611-43dafcd74302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.052959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d967f4-0e39-4f8e-8611-43dafcd74302 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.053387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d967f4-0e39-4f8e-8611-43dafcd74302 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.053804 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d967f4-0e39-4f8e-8611-43dafcd74302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.055243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a0c1b-3458-451b-b6f2-3d532fbe52bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.056705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a0c1b-3458-451b-b6f2-3d532fbe52bb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.065736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d967f4-0e39-4f8e-8611-43dafcd74302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.067242 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d967f4-0e39-4f8e-8611-43dafcd74302 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-858a0c1b-3458-451b-b6f2-3d532fbe52bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:06.070080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.070955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.073217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.073217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.073217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:06.073217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:06.073217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:06.073217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:06.073217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:06.073217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:06.073217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:06.073217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:06.076510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 239/500] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:06.077275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a0c1b-3458-451b-b6f2-3d532fbe52bb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-30d967f4-0e39-4f8e-8611-43dafcd74302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:06.085953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.088881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:06.092006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:06.092006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:06.092006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:06.092006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 262/501] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:06.092006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3b24c-9ea1-4357-be11-efd150b71be4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.092006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3b24c-9ea1-4357-be11-efd150b71be4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.092006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3b24c-9ea1-4357-be11-efd150b71be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.107073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-72c3b24c-9ea1-4357-be11-efd150b71be4 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:06.108266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-72c3b24c-9ea1-4357-be11-efd150b71be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:06.133733 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.183656 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 263/502] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:06.184508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3b24c-9ea1-4357-be11-efd150b71be4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.187066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a0c1b-3458-451b-b6f2-3d532fbe52bb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.197415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.224376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbf2bc-e451-4548-a3ad-cca9b895fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.225120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbf2bc-e451-4548-a3ad-cca9b895fd7e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.225475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbf2bc-e451-4548-a3ad-cca9b895fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.225667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbf2bc-e451-4548-a3ad-cca9b895fd7e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.234094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbf2bc-e451-4548-a3ad-cca9b895fd7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.235736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbf2bc-e451-4548-a3ad-cca9b895fd7e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-9bdbf2bc-e451-4548-a3ad-cca9b895fd7e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:06.247795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.248792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.249681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.249681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.249681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:06.249681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:06.249681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:06.249681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:06.249681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:06.249681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:06.249681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:27:06.249681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:06.255182 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 240/503] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:06.256243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbf2bc-e451-4548-a3ad-cca9b895fd7e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.296166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3b24c-9ea1-4357-be11-efd150b71be4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.332186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7192b4-102e-479f-95bf-fdaddaae6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.332713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7192b4-102e-479f-95bf-fdaddaae6c88 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.332995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7192b4-102e-479f-95bf-fdaddaae6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.333265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7192b4-102e-479f-95bf-fdaddaae6c88 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.334005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7192b4-102e-479f-95bf-fdaddaae6c88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.334315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7192b4-102e-479f-95bf-fdaddaae6c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.335806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7192b4-102e-479f-95bf-fdaddaae6c88 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.360010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbf2bc-e451-4548-a3ad-cca9b895fd7e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.372860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 264/504] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:06.373512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7192b4-102e-479f-95bf-fdaddaae6c88 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.392130 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.400188 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc872c-b4e6-416f-bd20-7aecb572536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.400919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc872c-b4e6-416f-bd20-7aecb572536c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.401219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc872c-b4e6-416f-bd20-7aecb572536c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.401500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc872c-b4e6-416f-bd20-7aecb572536c None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.402142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc872c-b4e6-416f-bd20-7aecb572536c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.402449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc872c-b4e6-416f-bd20-7aecb572536c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.403920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc872c-b4e6-416f-bd20-7aecb572536c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.421040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 241/505] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:06.421811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc872c-b4e6-416f-bd20-7aecb572536c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.452506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.477921 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7192b4-102e-479f-95bf-fdaddaae6c88 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.512247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff359ac-9cdb-4fa8-9468-0deebee343d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.512875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff359ac-9cdb-4fa8-9468-0deebee343d4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.513159 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff359ac-9cdb-4fa8-9468-0deebee343d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.513437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff359ac-9cdb-4fa8-9468-0deebee343d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.522782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc872c-b4e6-416f-bd20-7aecb572536c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.523381 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff359ac-9cdb-4fa8-9468-0deebee343d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7ff359ac-9cdb-4fa8-9468-0deebee343d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:06.528740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.529841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:06.530840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 265/506] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:06.531803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff359ac-9cdb-4fa8-9468-0deebee343d4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.560545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189e444-13a6-412a-830a-bff01bd73a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.561149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e444-13a6-412a-830a-bff01bd73a48 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.561428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e444-13a6-412a-830a-bff01bd73a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.561707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e444-13a6-412a-830a-bff01bd73a48 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.562428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189e444-13a6-412a-830a-bff01bd73a48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.562734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189e444-13a6-412a-830a-bff01bd73a48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.564322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189e444-13a6-412a-830a-bff01bd73a48 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.600222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 242/507] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:06.600965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189e444-13a6-412a-830a-bff01bd73a48 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.611450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.633096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff359ac-9cdb-4fa8-9468-0deebee343d4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.668376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e3769-4630-4b88-a8bf-744dba7ced55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.668979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e3769-4630-4b88-a8bf-744dba7ced55 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.669317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e3769-4630-4b88-a8bf-744dba7ced55 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.669591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e3769-4630-4b88-a8bf-744dba7ced55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.688748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.700589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189e444-13a6-412a-830a-bff01bd73a48 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.739515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7b268-2c91-4ba0-8d5b-3a85b2b87e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.740150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7b268-2c91-4ba0-8d5b-3a85b2b87e1c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.740430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7b268-2c91-4ba0-8d5b-3a85b2b87e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.740707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7b268-2c91-4ba0-8d5b-3a85b2b87e1c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.745373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e3769-4630-4b88-a8bf-744dba7ced55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.746859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e3769-4630-4b88-a8bf-744dba7ced55 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.748498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7b268-2c91-4ba0-8d5b-3a85b2b87e1c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.749947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7b268-2c91-4ba0-8d5b-3a85b2b87e1c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-96a7b268-2c91-4ba0-8d5b-3a85b2b87e1c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:06.762382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.764109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 243/508] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:06.765105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7b268-2c91-4ba0-8d5b-3a85b2b87e1c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.830060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.852380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 266/509] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:06.853149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e3769-4630-4b88-a8bf-744dba7ced55 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.878715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7b268-2c91-4ba0-8d5b-3a85b2b87e1c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.912318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635ffdd-8bdf-4150-a247-13c752cf07ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.913125 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635ffdd-8bdf-4150-a247-13c752cf07ca None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.913516 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635ffdd-8bdf-4150-a247-13c752cf07ca None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.913859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635ffdd-8bdf-4150-a247-13c752cf07ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.924435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635ffdd-8bdf-4150-a247-13c752cf07ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.925909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635ffdd-8bdf-4150-a247-13c752cf07ca None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.934951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c635ffdd-8bdf-4150-a247-13c752cf07ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:06.941419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.949849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:06.950874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:06.950874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:06.950874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:06.950874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 244/510] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:06.950874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635ffdd-8bdf-4150-a247-13c752cf07ca None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.957722 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e3769-4630-4b88-a8bf-744dba7ced55 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.992376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8d587-6294-4ff5-9317-26dee988d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.992988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8d587-6294-4ff5-9317-26dee988d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.993274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8d587-6294-4ff5-9317-26dee988d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.993551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8d587-6294-4ff5-9317-26dee988d9b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.994217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8d587-6294-4ff5-9317-26dee988d9b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.995040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8d587-6294-4ff5-9317-26dee988d9b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.996471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8d587-6294-4ff5-9317-26dee988d9b9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.004298 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 267/511] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:07.005080 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8d587-6294-4ff5-9317-26dee988d9b9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.048908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.049991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635ffdd-8bdf-4150-a247-13c752cf07ca None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.106550 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8d587-6294-4ff5-9317-26dee988d9b9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.127965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978756e8-9f0a-4d30-ada8-462ae1eb5d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.128569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978756e8-9f0a-4d30-ada8-462ae1eb5d6c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.128848 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978756e8-9f0a-4d30-ada8-462ae1eb5d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.129128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978756e8-9f0a-4d30-ada8-462ae1eb5d6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.139626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46bd9c-350c-400c-8352-5e2554e92dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.140312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46bd9c-350c-400c-8352-5e2554e92dcc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.140600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46bd9c-350c-400c-8352-5e2554e92dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.140882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46bd9c-350c-400c-8352-5e2554e92dcc None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.141605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46bd9c-350c-400c-8352-5e2554e92dcc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:07.141915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46bd9c-350c-400c-8352-5e2554e92dcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.143403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46bd9c-350c-400c-8352-5e2554e92dcc None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.160859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 268/512] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:07.161669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46bd9c-350c-400c-8352-5e2554e92dcc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.196209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.199194 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978756e8-9f0a-4d30-ada8-462ae1eb5d6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.200699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978756e8-9f0a-4d30-ada8-462ae1eb5d6c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.257897 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.262155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46bd9c-350c-400c-8352-5e2554e92dcc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.295114 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e9aef-0d91-499b-875f-8cc98af146d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.295747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e9aef-0d91-499b-875f-8cc98af146d4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.296030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e9aef-0d91-499b-875f-8cc98af146d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.296364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e9aef-0d91-499b-875f-8cc98af146d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.301989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 245/513] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:07.302650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978756e8-9f0a-4d30-ada8-462ae1eb5d6c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.306891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e9aef-0d91-499b-875f-8cc98af146d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.308975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e9aef-0d91-499b-875f-8cc98af146d4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-866e9aef-0d91-499b-875f-8cc98af146d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:07.323928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:07.324818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:07.325688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:07.325688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:07.325688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:07.325688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 269/514] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:07.326149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e9aef-0d91-499b-875f-8cc98af146d4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.407252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.410388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978756e8-9f0a-4d30-ada8-462ae1eb5d6c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.429013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e9aef-0d91-499b-875f-8cc98af146d4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.444549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceac7b4-c598-4ccf-a724-80d8a8a0c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.445155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceac7b4-c598-4ccf-a724-80d8a8a0c57b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.445434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceac7b4-c598-4ccf-a724-80d8a8a0c57b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.445707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceac7b4-c598-4ccf-a724-80d8a8a0c57b None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.446351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceac7b4-c598-4ccf-a724-80d8a8a0c57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:07.446655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceac7b4-c598-4ccf-a724-80d8a8a0c57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.448121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceac7b4-c598-4ccf-a724-80d8a8a0c57b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.459798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 246/515] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:07.460598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceac7b4-c598-4ccf-a724-80d8a8a0c57b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.461185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a068f9-4d7d-4c4f-a9f0-ba85f91b84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.461869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a068f9-4d7d-4c4f-a9f0-ba85f91b84f1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.462159 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a068f9-4d7d-4c4f-a9f0-ba85f91b84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.462435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a068f9-4d7d-4c4f-a9f0-ba85f91b84f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.473624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a068f9-4d7d-4c4f-a9f0-ba85f91b84f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.475138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a068f9-4d7d-4c4f-a9f0-ba85f91b84f1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c6a068f9-4d7d-4c4f-a9f0-ba85f91b84f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:07.489952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:07.490963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:07.491852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:07.491852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:07.491852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:07.491852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 270/516] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:07.492214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a068f9-4d7d-4c4f-a9f0-ba85f91b84f1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.494851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.566582 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceac7b4-c598-4ccf-a724-80d8a8a0c57b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.592551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a068f9-4d7d-4c4f-a9f0-ba85f91b84f1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.600747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59741a-c1de-40d7-8683-6dacf029a93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.601348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59741a-c1de-40d7-8683-6dacf029a93b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.601624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59741a-c1de-40d7-8683-6dacf029a93b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.601893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59741a-c1de-40d7-8683-6dacf029a93b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.625735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9a216-64e9-4a22-9406-9a2b5c7dd34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.626399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9a216-64e9-4a22-9406-9a2b5c7dd34f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.626634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9a216-64e9-4a22-9406-9a2b5c7dd34f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.626905 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9a216-64e9-4a22-9406-9a2b5c7dd34f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.629318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.638540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9a216-64e9-4a22-9406-9a2b5c7dd34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.642001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9a216-64e9-4a22-9406-9a2b5c7dd34f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0ca9a216-64e9-4a22-9406-9a2b5c7dd34f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:07.653813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:07.654777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:07.655685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:07.655685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:07.655685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:07.655685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 271/517] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:07.660066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9a216-64e9-4a22-9406-9a2b5c7dd34f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.672602 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59741a-c1de-40d7-8683-6dacf029a93b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.674098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59741a-c1de-40d7-8683-6dacf029a93b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.724226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.769974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9a216-64e9-4a22-9406-9a2b5c7dd34f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.774209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 247/518] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:07.775032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59741a-c1de-40d7-8683-6dacf029a93b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.805373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10248de5-d088-49db-bd3b-08dfe220da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.805977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10248de5-d088-49db-bd3b-08dfe220da32 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.806257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10248de5-d088-49db-bd3b-08dfe220da32 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.806528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10248de5-d088-49db-bd3b-08dfe220da32 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.807803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10248de5-d088-49db-bd3b-08dfe220da32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:07.808102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10248de5-d088-49db-bd3b-08dfe220da32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.809475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10248de5-d088-49db-bd3b-08dfe220da32 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.821163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 272/519] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:07.821802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10248de5-d088-49db-bd3b-08dfe220da32 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.833198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.873893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59741a-c1de-40d7-8683-6dacf029a93b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.908046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e65e1-68b7-46fb-87c2-19b3d6ab899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.908645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e65e1-68b7-46fb-87c2-19b3d6ab899d None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.908927 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e65e1-68b7-46fb-87c2-19b3d6ab899d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.909200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e65e1-68b7-46fb-87c2-19b3d6ab899d None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.909837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e65e1-68b7-46fb-87c2-19b3d6ab899d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.911397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e65e1-68b7-46fb-87c2-19b3d6ab899d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.926579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10248de5-d088-49db-bd3b-08dfe220da32 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.941298 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.960510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b4bb-1e14-4a90-b06f-023003f9a4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.961117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b4bb-1e14-4a90-b06f-023003f9a4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.961399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b4bb-1e14-4a90-b06f-023003f9a4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.961675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b4bb-1e14-4a90-b06f-023003f9a4e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.962340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621b4bb-1e14-4a90-b06f-023003f9a4e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:07.962630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621b4bb-1e14-4a90-b06f-023003f9a4e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.964117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621b4bb-1e14-4a90-b06f-023003f9a4e5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.975121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 273/520] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:07.975989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b4bb-1e14-4a90-b06f-023003f9a4e5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.983886 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 248/521] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:27:07 2022] POST /identity/v3/users => generated 247 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:07.984972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e65e1-68b7-46fb-87c2-19b3d6ab899d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.091257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b4bb-1e14-4a90-b06f-023003f9a4e5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.130723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03fffa-6494-433b-9980-74a7a78fb602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.131383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03fffa-6494-433b-9980-74a7a78fb602 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.131665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03fffa-6494-433b-9980-74a7a78fb602 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.131945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03fffa-6494-433b-9980-74a7a78fb602 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.132625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03fffa-6494-433b-9980-74a7a78fb602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.132935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03fffa-6494-433b-9980-74a7a78fb602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.134341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03fffa-6494-433b-9980-74a7a78fb602 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.141398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e65e1-68b7-46fb-87c2-19b3d6ab899d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.146676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 274/522] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.147549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03fffa-6494-433b-9980-74a7a78fb602 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.162381 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.188928 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1bb6c-157c-4a6f-9916-0ed12442a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.189577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1bb6c-157c-4a6f-9916-0ed12442a70d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.189856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1bb6c-157c-4a6f-9916-0ed12442a70d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.190133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1bb6c-157c-4a6f-9916-0ed12442a70d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.191833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.202191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1bb6c-157c-4a6f-9916-0ed12442a70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.203774 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1bb6c-157c-4a6f-9916-0ed12442a70d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-a4a1bb6c-157c-4a6f-9916-0ed12442a70d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:08.221080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.222388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:08.229385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:08.229385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:08.229385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:08.229385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 249/523] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:08.229385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1bb6c-157c-4a6f-9916-0ed12442a70d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.276468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03fffa-6494-433b-9980-74a7a78fb602 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.315318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c4626-878d-407a-8ef9-a8529e89f19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.315950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c4626-878d-407a-8ef9-a8529e89f19e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.316229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c4626-878d-407a-8ef9-a8529e89f19e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.316565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c4626-878d-407a-8ef9-a8529e89f19e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.323797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c4626-878d-407a-8ef9-a8529e89f19e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.325277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c4626-878d-407a-8ef9-a8529e89f19e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.331728 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1bb6c-157c-4a6f-9916-0ed12442a70d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cc0c4626-878d-407a-8ef9-a8529e89f19e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:08.337187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.338555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.346406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:08.346406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:08.346406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:08.346406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:08.346406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:08.346406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:08.346406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:08.346406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:08.346406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 275/524] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:08.346406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c4626-878d-407a-8ef9-a8529e89f19e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.378621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572d6fd-b04a-417b-b6b2-327e58e21928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.379583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572d6fd-b04a-417b-b6b2-327e58e21928 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.380130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572d6fd-b04a-417b-b6b2-327e58e21928 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.380408 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572d6fd-b04a-417b-b6b2-327e58e21928 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.389977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572d6fd-b04a-417b-b6b2-327e58e21928 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.392346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572d6fd-b04a-417b-b6b2-327e58e21928 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-5572d6fd-b04a-417b-b6b2-327e58e21928 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:08.406977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.407901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 250/525] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:08.413946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572d6fd-b04a-417b-b6b2-327e58e21928 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.443816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.444367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.451139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c4626-878d-407a-8ef9-a8529e89f19e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.490858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c9e05-8bb8-4c19-b98a-1c6c93c8a65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.491529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c9e05-8bb8-4c19-b98a-1c6c93c8a65d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.491844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c9e05-8bb8-4c19-b98a-1c6c93c8a65d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.492125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c9e05-8bb8-4c19-b98a-1c6c93c8a65d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.499694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c9e05-8bb8-4c19-b98a-1c6c93c8a65d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.501163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c9e05-8bb8-4c19-b98a-1c6c93c8a65d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-388c9e05-8bb8-4c19-b98a-1c6c93c8a65d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:08.512537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.513582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.514724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:08.514724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:08.514724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:08.514724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:08.514724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:08.514724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:08.514724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:08.514724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:08.514724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 276/526] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:08.514724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c9e05-8bb8-4c19-b98a-1c6c93c8a65d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.527315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572d6fd-b04a-417b-b6b2-327e58e21928 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.563010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c25587-c02a-44fc-a67c-c20204615436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.563645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c25587-c02a-44fc-a67c-c20204615436 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.564062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c25587-c02a-44fc-a67c-c20204615436 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.564341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c25587-c02a-44fc-a67c-c20204615436 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.564989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c25587-c02a-44fc-a67c-c20204615436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.565305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c25587-c02a-44fc-a67c-c20204615436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.566663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c25587-c02a-44fc-a67c-c20204615436 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.582577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 251/527] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.582577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c25587-c02a-44fc-a67c-c20204615436 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.622756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c9e05-8bb8-4c19-b98a-1c6c93c8a65d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.658281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac9a3d-2ed1-423d-b509-e78ff7e00fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.659207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac9a3d-2ed1-423d-b509-e78ff7e00fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.659691 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac9a3d-2ed1-423d-b509-e78ff7e00fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.660138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac9a3d-2ed1-423d-b509-e78ff7e00fc4 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.661032 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac9a3d-2ed1-423d-b509-e78ff7e00fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.661521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac9a3d-2ed1-423d-b509-e78ff7e00fc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.663161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac9a3d-2ed1-423d-b509-e78ff7e00fc4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.674159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.686039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c25587-c02a-44fc-a67c-c20204615436 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.701257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 277/528] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.701257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac9a3d-2ed1-423d-b509-e78ff7e00fc4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.708419 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.724826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a12d1-489a-4ebc-9cd7-ac01ae4732c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.725428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a12d1-489a-4ebc-9cd7-ac01ae4732c9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.726018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a12d1-489a-4ebc-9cd7-ac01ae4732c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.726018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a12d1-489a-4ebc-9cd7-ac01ae4732c9 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.726674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a12d1-489a-4ebc-9cd7-ac01ae4732c9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.726979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a12d1-489a-4ebc-9cd7-ac01ae4732c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.728443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a12d1-489a-4ebc-9cd7-ac01ae4732c9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.746782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 252/529] 10.222.0.88 () {56 vars in 1139 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.747985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a12d1-489a-4ebc-9cd7-ac01ae4732c9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.800985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac9a3d-2ed1-423d-b509-e78ff7e00fc4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.841690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4598c-96a8-4181-85d5-334115a737a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.841690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4598c-96a8-4181-85d5-334115a737a6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.841690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4598c-96a8-4181-85d5-334115a737a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.841690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4598c-96a8-4181-85d5-334115a737a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.842101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4598c-96a8-4181-85d5-334115a737a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.842101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4598c-96a8-4181-85d5-334115a737a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.842885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4598c-96a8-4181-85d5-334115a737a6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.855447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 278/530] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.856513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4598c-96a8-4181-85d5-334115a737a6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.874057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a12d1-489a-4ebc-9cd7-ac01ae4732c9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.915474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520f97-119f-41d3-8cdd-9558a2eb0b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.916141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520f97-119f-41d3-8cdd-9558a2eb0b96 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.916395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520f97-119f-41d3-8cdd-9558a2eb0b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.916674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520f97-119f-41d3-8cdd-9558a2eb0b96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.923516 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02520f97-119f-41d3-8cdd-9558a2eb0b96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.925023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02520f97-119f-41d3-8cdd-9558a2eb0b96 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-02520f97-119f-41d3-8cdd-9558a2eb0b96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:08.937216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.938055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.944065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:08.944065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:08.944065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:08.944065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:08.944065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:08.944065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:08.944065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:08.944065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:08.944065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 253/531] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:08.944065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520f97-119f-41d3-8cdd-9558a2eb0b96 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.944585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.952419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.976400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4598c-96a8-4181-85d5-334115a737a6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.013263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f22d78-5b4c-42a7-98f5-182988924eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.013871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f22d78-5b4c-42a7-98f5-182988924eaa None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.014213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f22d78-5b4c-42a7-98f5-182988924eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.014495 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f22d78-5b4c-42a7-98f5-182988924eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.015261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f22d78-5b4c-42a7-98f5-182988924eaa None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=9624bc4b2840420eb06d721a73655da4) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.015575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f22d78-5b4c-42a7-98f5-182988924eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.017053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f22d78-5b4c-42a7-98f5-182988924eaa None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.035089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 279/532] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/role_assignments?user.id=9624bc4b2840420eb06d721a73655da4&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:09.035089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f22d78-5b4c-42a7-98f5-182988924eaa None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.052164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520f97-119f-41d3-8cdd-9558a2eb0b96 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.090888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf39c0-8a08-4087-b836-004cfeb5a6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.091554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf39c0-8a08-4087-b836-004cfeb5a6cb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.091841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf39c0-8a08-4087-b836-004cfeb5a6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.092118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf39c0-8a08-4087-b836-004cfeb5a6cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.175482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf39c0-8a08-4087-b836-004cfeb5a6cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.176900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf39c0-8a08-4087-b836-004cfeb5a6cb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.186224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.189296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f22d78-5b4c-42a7-98f5-182988924eaa None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.229595 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb1f3b-bbfc-4a8c-abf6-f363f9233531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.230387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1f3b-bbfc-4a8c-abf6-f363f9233531 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.230750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1f3b-bbfc-4a8c-abf6-f363f9233531 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.231116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1f3b-bbfc-4a8c-abf6-f363f9233531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.232168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb1f3b-bbfc-4a8c-abf6-f363f9233531 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=6955fc5b81a040f686e21621ea968a6e) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.232551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb1f3b-bbfc-4a8c-abf6-f363f9233531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.234069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb1f3b-bbfc-4a8c-abf6-f363f9233531 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.240163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 280/533] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/role_assignments?user.id=6955fc5b81a040f686e21621ea968a6e&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:09.241067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb1f3b-bbfc-4a8c-abf6-f363f9233531 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.246404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.315947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 254/534] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:09.321538 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf39c0-8a08-4087-b836-004cfeb5a6cb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.461899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb1f3b-bbfc-4a8c-abf6-f363f9233531 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.519142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f7c5-29d2-490c-9cee-4084dd185c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.519769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f7c5-29d2-490c-9cee-4084dd185c22 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.520044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f7c5-29d2-490c-9cee-4084dd185c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.520314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f7c5-29d2-490c-9cee-4084dd185c22 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.521013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478f7c5-29d2-490c-9cee-4084dd185c22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.521317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478f7c5-29d2-490c-9cee-4084dd185c22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.522763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478f7c5-29d2-490c-9cee-4084dd185c22 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.530257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf39c0-8a08-4087-b836-004cfeb5a6cb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.545817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.552218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 281/535] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:09.559792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f7c5-29d2-490c-9cee-4084dd185c22 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.603515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59e826-33dc-4cf6-98ec-4ef000d600de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.604676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e826-33dc-4cf6-98ec-4ef000d600de None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.604957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e826-33dc-4cf6-98ec-4ef000d600de None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.605227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e826-33dc-4cf6-98ec-4ef000d600de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.630521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59e826-33dc-4cf6-98ec-4ef000d600de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.632039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59e826-33dc-4cf6-98ec-4ef000d600de None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-3e59e826-33dc-4cf6-98ec-4ef000d600de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:09.663799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:09.664823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:09.665663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:09.665663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:09.665663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:09.668275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.673907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 255/536] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:09.678995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59e826-33dc-4cf6-98ec-4ef000d600de None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.727297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f7c5-29d2-490c-9cee-4084dd185c22 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.764682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ef7b5-b22a-4729-b759-ea6469ae89b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.765750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ef7b5-b22a-4729-b759-ea6469ae89b8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.766031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ef7b5-b22a-4729-b759-ea6469ae89b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.766308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ef7b5-b22a-4729-b759-ea6469ae89b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.767027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ef7b5-b22a-4729-b759-ea6469ae89b8 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=380240bcfca240a2b4969f6618409a2f) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.767361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ef7b5-b22a-4729-b759-ea6469ae89b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.768808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ef7b5-b22a-4729-b759-ea6469ae89b8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.786049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 282/537] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/role_assignments?user.id=380240bcfca240a2b4969f6618409a2f&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:09.854022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59e826-33dc-4cf6-98ec-4ef000d600de None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.893213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38501096-d599-4384-adb4-195dacec5580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.894193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501096-d599-4384-adb4-195dacec5580 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.894699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501096-d599-4384-adb4-195dacec5580 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.895204 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501096-d599-4384-adb4-195dacec5580 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.896100 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38501096-d599-4384-adb4-195dacec5580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.896624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38501096-d599-4384-adb4-195dacec5580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.898373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38501096-d599-4384-adb4-195dacec5580 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.911825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 256/538] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:09.920515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ef7b5-b22a-4729-b759-ea6469ae89b8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.964302 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c2419-6634-41de-90af-d08d64510886 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.964638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c2419-6634-41de-90af-d08d64510886 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.964858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c2419-6634-41de-90af-d08d64510886 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.966366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 257/539] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:09.972254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad14d0-0362-47b7-943d-38d0d3038cba None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.972820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad14d0-0362-47b7-943d-38d0d3038cba None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.973310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad14d0-0362-47b7-943d-38d0d3038cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.008057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1aad14d0-0362-47b7-943d-38d0d3038cba None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:10.011110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1aad14d0-0362-47b7-943d-38d0d3038cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:10.052734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.091509 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ef7b5-b22a-4729-b759-ea6469ae89b8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.118127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 258/540] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:10.141439 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.157058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779657d-71fc-4985-be78-8697768c7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.157699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779657d-71fc-4985-be78-8697768c7890 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.157981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779657d-71fc-4985-be78-8697768c7890 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.158250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779657d-71fc-4985-be78-8697768c7890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.172077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779657d-71fc-4985-be78-8697768c7890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.173546 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779657d-71fc-4985-be78-8697768c7890 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-e779657d-71fc-4985-be78-8697768c7890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:10.196358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:10.197284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:10.198161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:10.198161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:10.198161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:10.198161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:10.198161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:10.198161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:10.198161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:10.198161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:10.198161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 283/541] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:10.203207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad14d0-0362-47b7-943d-38d0d3038cba None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.349616 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad14d0-0362-47b7-943d-38d0d3038cba None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.386207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d9701-9c10-4349-8a69-80b7a85f3577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.386945 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9701-9c10-4349-8a69-80b7a85f3577 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.387253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9701-9c10-4349-8a69-80b7a85f3577 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.387614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9701-9c10-4349-8a69-80b7a85f3577 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.388322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d9701-9c10-4349-8a69-80b7a85f3577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.388624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d9701-9c10-4349-8a69-80b7a85f3577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.390083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d9701-9c10-4349-8a69-80b7a85f3577 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.410562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 259/542] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.416098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779657d-71fc-4985-be78-8697768c7890 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.449471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d9701-9c10-4349-8a69-80b7a85f3577 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.463439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.572070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d9701-9c10-4349-8a69-80b7a85f3577 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.629292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fb0d7-6746-4498-8b85-807be09e73d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.631339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fb0d7-6746-4498-8b85-807be09e73d2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.632739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fb0d7-6746-4498-8b85-807be09e73d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.633277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fb0d7-6746-4498-8b85-807be09e73d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.655923 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fb0d7-6746-4498-8b85-807be09e73d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:10.662829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779657d-71fc-4985-be78-8697768c7890 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f93fb0d7-6746-4498-8b85-807be09e73d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:10.666147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:10.667000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:10.667829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:10.674281 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 260/543] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:10.701437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fb0d7-6746-4498-8b85-807be09e73d2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.723810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076990e-254e-49a4-8d74-cc745cc0ac90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.724436 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076990e-254e-49a4-8d74-cc745cc0ac90 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.724720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076990e-254e-49a4-8d74-cc745cc0ac90 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.724998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076990e-254e-49a4-8d74-cc745cc0ac90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.725735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076990e-254e-49a4-8d74-cc745cc0ac90 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=b4ab7a3b191e4a0b84b396cafa8a9ff7) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.726044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076990e-254e-49a4-8d74-cc745cc0ac90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.727520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076990e-254e-49a4-8d74-cc745cc0ac90 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.738090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 284/544] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/role_assignments?user.id=b4ab7a3b191e4a0b84b396cafa8a9ff7&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.792922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.847240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fb0d7-6746-4498-8b85-807be09e73d2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.904800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397c028-b669-4d41-9909-289016912eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.905339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397c028-b669-4d41-9909-289016912eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.905621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397c028-b669-4d41-9909-289016912eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.905896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397c028-b669-4d41-9909-289016912eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.906655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397c028-b669-4d41-9909-289016912eb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.906967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397c028-b669-4d41-9909-289016912eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.908399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397c028-b669-4d41-9909-289016912eb1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.918138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 261/545] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:10.924025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076990e-254e-49a4-8d74-cc745cc0ac90 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.987677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.051116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076990e-254e-49a4-8d74-cc745cc0ac90 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.087590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bfd07-0030-4dd6-8c2e-05dbce927796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.088341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bfd07-0030-4dd6-8c2e-05dbce927796 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.088627 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bfd07-0030-4dd6-8c2e-05dbce927796 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.088897 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bfd07-0030-4dd6-8c2e-05dbce927796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.101127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bfd07-0030-4dd6-8c2e-05dbce927796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.102633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bfd07-0030-4dd6-8c2e-05dbce927796 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-316bfd07-0030-4dd6-8c2e-05dbce927796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:11.118915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:11.119942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:11.120867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:11.120867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:11.120867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:11.120867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 285/546] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:11.126102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397c028-b669-4d41-9909-289016912eb1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.254476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397c028-b669-4d41-9909-289016912eb1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.286261 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.289405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb335ee-2276-4aa4-81ca-3fdec70476b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.290023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb335ee-2276-4aa4-81ca-3fdec70476b9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.290544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb335ee-2276-4aa4-81ca-3fdec70476b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.290919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb335ee-2276-4aa4-81ca-3fdec70476b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.291748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb335ee-2276-4aa4-81ca-3fdec70476b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:11.292146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb335ee-2276-4aa4-81ca-3fdec70476b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.293613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb335ee-2276-4aa4-81ca-3fdec70476b9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.306387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 262/547] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:11.312471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bfd07-0030-4dd6-8c2e-05dbce927796 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.427225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bfd07-0030-4dd6-8c2e-05dbce927796 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.429021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.472272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c899c3-372d-4a07-86cd-07306b7a08e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.473205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c899c3-372d-4a07-86cd-07306b7a08e9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.473691 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c899c3-372d-4a07-86cd-07306b7a08e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.474107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c899c3-372d-4a07-86cd-07306b7a08e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.482989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c899c3-372d-4a07-86cd-07306b7a08e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.484723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c899c3-372d-4a07-86cd-07306b7a08e9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-51c899c3-372d-4a07-86cd-07306b7a08e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:11.499636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:11.500929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:11.502019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:11.502019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:11.502019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:11.502019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:11.502019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:11.502019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:11.502019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:11.502019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:11.502019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:11.502019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:11.504269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 286/548] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:11.510579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb335ee-2276-4aa4-81ca-3fdec70476b9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.521715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ee60d-d50e-403e-a32a-a1b1ca1b1b6e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.521997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ee60d-d50e-403e-a32a-a1b1ca1b1b6e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.522274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ee60d-d50e-403e-a32a-a1b1ca1b1b6e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.532286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 287/549] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:11.534218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898601-e771-4295-a577-e1988fa9be4b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.534513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898601-e771-4295-a577-e1988fa9be4b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.534793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898601-e771-4295-a577-e1988fa9be4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.564997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d7898601-e771-4295-a577-e1988fa9be4b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:11.566213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d7898601-e771-4295-a577-e1988fa9be4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:11.665616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 288/550] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:11.670992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb335ee-2276-4aa4-81ca-3fdec70476b9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.675580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917c6c-f155-4aec-9d40-e0d91c601286 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.676119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917c6c-f155-4aec-9d40-e0d91c601286 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.676588 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917c6c-f155-4aec-9d40-e0d91c601286 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.683075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 289/551] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:11 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:11.684623 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00831-0a50-4077-a2ff-d66f39374369 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.684831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00831-0a50-4077-a2ff-d66f39374369 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.685004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00831-0a50-4077-a2ff-d66f39374369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.714245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b79e18-51a7-461a-a9fb-ef4cc42a617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.715304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b79e18-51a7-461a-a9fb-ef4cc42a617b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.715788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b79e18-51a7-461a-a9fb-ef4cc42a617b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.716323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b79e18-51a7-461a-a9fb-ef4cc42a617b None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.717336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b79e18-51a7-461a-a9fb-ef4cc42a617b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:11.717895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b79e18-51a7-461a-a9fb-ef4cc42a617b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.719699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b79e18-51a7-461a-a9fb-ef4cc42a617b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.722181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6ec00831-0a50-4077-a2ff-d66f39374369 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:11.723718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ec00831-0a50-4077-a2ff-d66f39374369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:11.741922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 263/552] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:11.750886 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b79e18-51a7-461a-a9fb-ef4cc42a617b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.811867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 290/553] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:27:11.862836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.931445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b79e18-51a7-461a-a9fb-ef4cc42a617b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.977428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec00831-0a50-4077-a2ff-d66f39374369 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.978144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ab10b-0b5f-40cd-b571-f2722ee050cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.978824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ab10b-0b5f-40cd-b571-f2722ee050cb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.979134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ab10b-0b5f-40cd-b571-f2722ee050cb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.979411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ab10b-0b5f-40cd-b571-f2722ee050cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.003856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.084074 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ab10b-0b5f-40cd-b571-f2722ee050cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.085776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ab10b-0b5f-40cd-b571-f2722ee050cb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.100181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec00831-0a50-4077-a2ff-d66f39374369 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.140254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a48263-5b24-4ccd-a48a-8175c91b4e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.141051 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a48263-5b24-4ccd-a48a-8175c91b4e7c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.142020 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a48263-5b24-4ccd-a48a-8175c91b4e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.142537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a48263-5b24-4ccd-a48a-8175c91b4e7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.155977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.158920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a48263-5b24-4ccd-a48a-8175c91b4e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-37a48263-5b24-4ccd-a48a-8175c91b4e7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:12.166594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:12.171580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:12.172660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 291/554] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:12.174091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab89e-b172-4162-9635-61c2c2d86575 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.174519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab89e-b172-4162-9635-61c2c2d86575 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.174926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab89e-b172-4162-9635-61c2c2d86575 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.177019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 292/555] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:12.177895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab89e-b172-4162-9635-61c2c2d86575 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.221948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 264/556] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:12.223576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e748784-f859-4dd8-83e0-4020326812fb None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.224033 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e748784-f859-4dd8-83e0-4020326812fb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.224446 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e748784-f859-4dd8-83e0-4020326812fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.246219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3e748784-f859-4dd8-83e0-4020326812fb None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:12.247526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3e748784-f859-4dd8-83e0-4020326812fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:12.277347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.296627 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab89e-b172-4162-9635-61c2c2d86575 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.325931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 265/557] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:12.326782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e748784-f859-4dd8-83e0-4020326812fb None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.337910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e34d8-8637-4515-9b0f-0948c07c0bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.337910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e34d8-8637-4515-9b0f-0948c07c0bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.337910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e34d8-8637-4515-9b0f-0948c07c0bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.337910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e34d8-8637-4515-9b0f-0948c07c0bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.338757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e34d8-8637-4515-9b0f-0948c07c0bd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:12.338757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e34d8-8637-4515-9b0f-0948c07c0bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.338878 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e34d8-8637-4515-9b0f-0948c07c0bd3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.351234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 293/558] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:12.352422 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e34d8-8637-4515-9b0f-0948c07c0bd3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.437588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.464515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e748784-f859-4dd8-83e0-4020326812fb None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.470369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e34d8-8637-4515-9b0f-0948c07c0bd3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.501334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d131a-ceee-4d98-8667-a06711f92989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.501763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d131a-ceee-4d98-8667-a06711f92989 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.502044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d131a-ceee-4d98-8667-a06711f92989 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.502315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d131a-ceee-4d98-8667-a06711f92989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.507203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847334be-1a67-4c0e-8e90-1895b0690174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.508168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847334be-1a67-4c0e-8e90-1895b0690174 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.508665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847334be-1a67-4c0e-8e90-1895b0690174 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.509137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847334be-1a67-4c0e-8e90-1895b0690174 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.514475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d131a-ceee-4d98-8667-a06711f92989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.516026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d131a-ceee-4d98-8667-a06711f92989 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.522348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847334be-1a67-4c0e-8e90-1895b0690174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-847334be-1a67-4c0e-8e90-1895b0690174 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:12.528075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:12.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:12.529818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-197d131a-ceee-4d98-8667-a06711f92989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:12.537123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:12.538072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:12.538953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:12.538953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:12.538953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:12.538953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 266/559] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:12.538953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d131a-ceee-4d98-8667-a06711f92989 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.540110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 294/560] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:12.541714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847334be-1a67-4c0e-8e90-1895b0690174 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.545780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.643592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d131a-ceee-4d98-8667-a06711f92989 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.646483 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847334be-1a67-4c0e-8e90-1895b0690174 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.674076 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.680739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d209aff-3984-4b5c-8327-7c3cde04a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.681377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d209aff-3984-4b5c-8327-7c3cde04a38c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.681692 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d209aff-3984-4b5c-8327-7c3cde04a38c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.681963 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d209aff-3984-4b5c-8327-7c3cde04a38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.682800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af8b48-0c1c-4697-9752-ebc7a523ae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.683511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af8b48-0c1c-4697-9752-ebc7a523ae11 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.683738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af8b48-0c1c-4697-9752-ebc7a523ae11 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.684014 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af8b48-0c1c-4697-9752-ebc7a523ae11 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.684769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af8b48-0c1c-4697-9752-ebc7a523ae11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:12.685085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af8b48-0c1c-4697-9752-ebc7a523ae11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.686463 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af8b48-0c1c-4697-9752-ebc7a523ae11 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.693002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d209aff-3984-4b5c-8327-7c3cde04a38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.694448 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d209aff-3984-4b5c-8327-7c3cde04a38c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.699570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 295/561] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:12.699570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af8b48-0c1c-4697-9752-ebc7a523ae11 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-9d209aff-3984-4b5c-8327-7c3cde04a38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:12.716318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:12.717402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:12.718851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:12.718851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:12.718851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:12.718851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 267/562] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:12.718851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d209aff-3984-4b5c-8327-7c3cde04a38c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.781145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.820434 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af8b48-0c1c-4697-9752-ebc7a523ae11 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.834652 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d209aff-3984-4b5c-8327-7c3cde04a38c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.859541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9a3f-8aba-41cf-a72e-b6e9e26d58d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.860162 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9a3f-8aba-41cf-a72e-b6e9e26d58d9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.860532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9a3f-8aba-41cf-a72e-b6e9e26d58d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.860816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9a3f-8aba-41cf-a72e-b6e9e26d58d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.861466 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd9a3f-8aba-41cf-a72e-b6e9e26d58d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:12.861769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd9a3f-8aba-41cf-a72e-b6e9e26d58d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.865030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd9a3f-8aba-41cf-a72e-b6e9e26d58d9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.872385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66de57-f88b-41b4-9c7c-ee951ff6f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.873023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66de57-f88b-41b4-9c7c-ee951ff6f138 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.873307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66de57-f88b-41b4-9c7c-ee951ff6f138 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.873580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66de57-f88b-41b4-9c7c-ee951ff6f138 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.884746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 296/563] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:12.884746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9a3f-8aba-41cf-a72e-b6e9e26d58d9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.885074 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66de57-f88b-41b4-9c7c-ee951ff6f138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-ec66de57-f88b-41b4-9c7c-ee951ff6f138 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:12.890292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:12.891233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:12.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 268/564] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:12.892926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66de57-f88b-41b4-9c7c-ee951ff6f138 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.940953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.999178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9a3f-8aba-41cf-a72e-b6e9e26d58d9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.002496 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66de57-f88b-41b4-9c7c-ee951ff6f138 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.025360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.034296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011a6be-d904-4344-ba50-dfb54e1e1136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.034932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011a6be-d904-4344-ba50-dfb54e1e1136 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.035244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011a6be-d904-4344-ba50-dfb54e1e1136 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.035514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011a6be-d904-4344-ba50-dfb54e1e1136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.038030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29f899-1c75-4951-9c1a-c62c75ba5252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.038635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29f899-1c75-4951-9c1a-c62c75ba5252 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.038918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29f899-1c75-4951-9c1a-c62c75ba5252 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.039223 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29f899-1c75-4951-9c1a-c62c75ba5252 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.039936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29f899-1c75-4951-9c1a-c62c75ba5252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.040253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29f899-1c75-4951-9c1a-c62c75ba5252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.042147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29f899-1c75-4951-9c1a-c62c75ba5252 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.046203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011a6be-d904-4344-ba50-dfb54e1e1136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.051136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011a6be-d904-4344-ba50-dfb54e1e1136 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.054557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 269/565] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.059900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29f899-1c75-4951-9c1a-c62c75ba5252 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-6011a6be-d904-4344-ba50-dfb54e1e1136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:13.062898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:13.063902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:13.064784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:13.064784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:13.064784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:13.064784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 297/566] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:13.064784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011a6be-d904-4344-ba50-dfb54e1e1136 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.172406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011a6be-d904-4344-ba50-dfb54e1e1136 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.188509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29f899-1c75-4951-9c1a-c62c75ba5252 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.190154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.205532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12659afa-1913-434c-b581-b0541f35bce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.205845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12659afa-1913-434c-b581-b0541f35bce9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.206321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12659afa-1913-434c-b581-b0541f35bce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.206431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12659afa-1913-434c-b581-b0541f35bce9 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.207032 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12659afa-1913-434c-b581-b0541f35bce9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.207364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12659afa-1913-434c-b581-b0541f35bce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.208746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12659afa-1913-434c-b581-b0541f35bce9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.221935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 298/567] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.221935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12659afa-1913-434c-b581-b0541f35bce9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.224226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187edfd2-19e4-4369-9e41-f085bb227935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.224876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187edfd2-19e4-4369-9e41-f085bb227935 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.225339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187edfd2-19e4-4369-9e41-f085bb227935 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.225994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187edfd2-19e4-4369-9e41-f085bb227935 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.233244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187edfd2-19e4-4369-9e41-f085bb227935 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.234695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187edfd2-19e4-4369-9e41-f085bb227935 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-187edfd2-19e4-4369-9e41-f085bb227935 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:13.245698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:13.246716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:13.247722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:13.247722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:13.247722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:13.247722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:13.247722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:13.247722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:13.247722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:13.247722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:13.247722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 270/568] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:13.247722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187edfd2-19e4-4369-9e41-f085bb227935 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.266446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.323794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12659afa-1913-434c-b581-b0541f35bce9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.346242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187edfd2-19e4-4369-9e41-f085bb227935 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.357251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0c2cf-e57d-4056-a771-c0646d76172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.357885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0c2cf-e57d-4056-a771-c0646d76172c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.358175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0c2cf-e57d-4056-a771-c0646d76172c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.358454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0c2cf-e57d-4056-a771-c0646d76172c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.365828 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0c2cf-e57d-4056-a771-c0646d76172c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.367315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0c2cf-e57d-4056-a771-c0646d76172c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-5fc0c2cf-e57d-4056-a771-c0646d76172c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:13.379723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:13.380875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:13.382090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:13.382090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:13.382090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:13.382090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:13.382090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:13.382090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:13.382090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:13.382090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:13.382090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:27:13.382090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:13.382754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3248-1bab-4664-8ad0-4a4bc4c9e08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.382754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3248-1bab-4664-8ad0-4a4bc4c9e08a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.382754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3248-1bab-4664-8ad0-4a4bc4c9e08a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.382754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3248-1bab-4664-8ad0-4a4bc4c9e08a None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.383068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb3248-1bab-4664-8ad0-4a4bc4c9e08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.383068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb3248-1bab-4664-8ad0-4a4bc4c9e08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.383572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb3248-1bab-4664-8ad0-4a4bc4c9e08a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.386024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 299/569] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:13.387238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961eb7b-6dff-403d-ac8e-7ace26c443fa None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.387528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961eb7b-6dff-403d-ac8e-7ace26c443fa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.387802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961eb7b-6dff-403d-ac8e-7ace26c443fa None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.389063 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 300/570] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:13.389762 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961eb7b-6dff-403d-ac8e-7ace26c443fa None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.398980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 271/571] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.398980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3248-1bab-4664-8ad0-4a4bc4c9e08a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.422808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.488986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.493018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961eb7b-6dff-403d-ac8e-7ace26c443fa None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.497852 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3248-1bab-4664-8ad0-4a4bc4c9e08a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.528367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0715a-9e9f-4f08-b8ee-934e7d3fc70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.528991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0715a-9e9f-4f08-b8ee-934e7d3fc70a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.529272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0715a-9e9f-4f08-b8ee-934e7d3fc70a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.529542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0715a-9e9f-4f08-b8ee-934e7d3fc70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.531767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab53e39-5f04-49f0-9181-4b4312456bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.532370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab53e39-5f04-49f0-9181-4b4312456bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.532652 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab53e39-5f04-49f0-9181-4b4312456bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.532924 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab53e39-5f04-49f0-9181-4b4312456bd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.533615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab53e39-5f04-49f0-9181-4b4312456bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.533925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab53e39-5f04-49f0-9181-4b4312456bd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.535405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab53e39-5f04-49f0-9181-4b4312456bd1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.539443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0715a-9e9f-4f08-b8ee-934e7d3fc70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.540926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0715a-9e9f-4f08-b8ee-934e7d3fc70a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.547323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 272/572] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.548121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab53e39-5f04-49f0-9181-4b4312456bd1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cdf0715a-9e9f-4f08-b8ee-934e7d3fc70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:13.560865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:13.561885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:13.567576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:13.567576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:13.567576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:13.567576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 301/573] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:13.567576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92960-13a5-4fbd-a657-54c42358f20d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.567576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92960-13a5-4fbd-a657-54c42358f20d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.567576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92960-13a5-4fbd-a657-54c42358f20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.580832 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1de92960-13a5-4fbd-a657-54c42358f20d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:13.582026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1de92960-13a5-4fbd-a657-54c42358f20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:13.632406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.649456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 302/574] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:13.650318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92960-13a5-4fbd-a657-54c42358f20d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.650642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab53e39-5f04-49f0-9181-4b4312456bd1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.697801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a163c-fa7a-4100-a80f-4ce1172edf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.698406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a163c-fa7a-4100-a80f-4ce1172edf48 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.698687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a163c-fa7a-4100-a80f-4ce1172edf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.698961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a163c-fa7a-4100-a80f-4ce1172edf48 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.699722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a163c-fa7a-4100-a80f-4ce1172edf48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.700030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a163c-fa7a-4100-a80f-4ce1172edf48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.701476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a163c-fa7a-4100-a80f-4ce1172edf48 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.718519 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 273/575] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.719371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a163c-fa7a-4100-a80f-4ce1172edf48 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.738850 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.759321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92960-13a5-4fbd-a657-54c42358f20d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.802055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f1397-5199-49b5-b0ed-3db493b747fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.802800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f1397-5199-49b5-b0ed-3db493b747fa None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.803111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f1397-5199-49b5-b0ed-3db493b747fa None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.803379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f1397-5199-49b5-b0ed-3db493b747fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.811295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f1397-5199-49b5-b0ed-3db493b747fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.812774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f1397-5199-49b5-b0ed-3db493b747fa None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-fb3f1397-5199-49b5-b0ed-3db493b747fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:13.827016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:13.828210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 303/576] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:13.834120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f1397-5199-49b5-b0ed-3db493b747fa None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.844628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a163c-fa7a-4100-a80f-4ce1172edf48 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.889370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ecab1-427f-457c-9944-ac0892dcdb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.890702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ecab1-427f-457c-9944-ac0892dcdb53 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.890996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ecab1-427f-457c-9944-ac0892dcdb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.891299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ecab1-427f-457c-9944-ac0892dcdb53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.892240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ecab1-427f-457c-9944-ac0892dcdb53 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=d4052d31496a46948211cd4b7d38808b) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.892571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ecab1-427f-457c-9944-ac0892dcdb53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.894055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ecab1-427f-457c-9944-ac0892dcdb53 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.900377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 274/577] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/role_assignments?user.id=d4052d31496a46948211cd4b7d38808b&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.908714 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ecab1-427f-457c-9944-ac0892dcdb53 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.914403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.955469 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f1397-5199-49b5-b0ed-3db493b747fa None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.999678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f90d4a-0cc4-4367-a1e9-9689b0ba1082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.000317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f90d4a-0cc4-4367-a1e9-9689b0ba1082 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.000601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f90d4a-0cc4-4367-a1e9-9689b0ba1082 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.000887 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f90d4a-0cc4-4367-a1e9-9689b0ba1082 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.001561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f90d4a-0cc4-4367-a1e9-9689b0ba1082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:14.001874 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f90d4a-0cc4-4367-a1e9-9689b0ba1082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.003321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f90d4a-0cc4-4367-a1e9-9689b0ba1082 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.020729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 304/578] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:14.026348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f90d4a-0cc4-4367-a1e9-9689b0ba1082 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.029569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.056105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ecab1-427f-457c-9944-ac0892dcdb53 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.154345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825f3ee-e5f8-4895-86fb-ac9cbb313280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.155334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f3ee-e5f8-4895-86fb-ac9cbb313280 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.155751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f3ee-e5f8-4895-86fb-ac9cbb313280 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.156217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f3ee-e5f8-4895-86fb-ac9cbb313280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.170070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825f3ee-e5f8-4895-86fb-ac9cbb313280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.172286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825f3ee-e5f8-4895-86fb-ac9cbb313280 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f825f3ee-e5f8-4895-86fb-ac9cbb313280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:14.188486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:14.189530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:14.190493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:14.190493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:14.190493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:14.190493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 275/579] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:14.190493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825f3ee-e5f8-4895-86fb-ac9cbb313280 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.201822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f90d4a-0cc4-4367-a1e9-9689b0ba1082 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.247836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195fbc-d53a-43c9-b7f0-1c1ed1437e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.248443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195fbc-d53a-43c9-b7f0-1c1ed1437e95 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.248726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195fbc-d53a-43c9-b7f0-1c1ed1437e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.248993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195fbc-d53a-43c9-b7f0-1c1ed1437e95 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.249732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b195fbc-d53a-43c9-b7f0-1c1ed1437e95 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:14.250038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b195fbc-d53a-43c9-b7f0-1c1ed1437e95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.251516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b195fbc-d53a-43c9-b7f0-1c1ed1437e95 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.259392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.275976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 305/580] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:14.275976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195fbc-d53a-43c9-b7f0-1c1ed1437e95 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.314682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825f3ee-e5f8-4895-86fb-ac9cbb313280 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.341608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.356100 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53bff9-1fb4-473f-b80d-94e00ab9e4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.357095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53bff9-1fb4-473f-b80d-94e00ab9e4fd None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.357444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53bff9-1fb4-473f-b80d-94e00ab9e4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.358126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53bff9-1fb4-473f-b80d-94e00ab9e4fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.370902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53bff9-1fb4-473f-b80d-94e00ab9e4fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-ff53bff9-1fb4-473f-b80d-94e00ab9e4fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:14.376657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:14.379160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 276/581] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:14.381518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53bff9-1fb4-473f-b80d-94e00ab9e4fd None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.393342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195fbc-d53a-43c9-b7f0-1c1ed1437e95 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.437179 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1a32-4349-4c05-ae41-a3d52744f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.438072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1a32-4349-4c05-ae41-a3d52744f024 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.438347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1a32-4349-4c05-ae41-a3d52744f024 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.438618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1a32-4349-4c05-ae41-a3d52744f024 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.446129 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1a32-4349-4c05-ae41-a3d52744f024 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.447668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1a32-4349-4c05-ae41-a3d52744f024 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-339d1a32-4349-4c05-ae41-a3d52744f024 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:14.459820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:14.460830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 306/582] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:14.461845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1a32-4349-4c05-ae41-a3d52744f024 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.508793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53bff9-1fb4-473f-b80d-94e00ab9e4fd None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.528650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.548723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dab42-b012-41d1-ab22-e9e830343681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.549394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dab42-b012-41d1-ab22-e9e830343681 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.549636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dab42-b012-41d1-ab22-e9e830343681 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.549879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dab42-b012-41d1-ab22-e9e830343681 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.550548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dab42-b012-41d1-ab22-e9e830343681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:14.550856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dab42-b012-41d1-ab22-e9e830343681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.552302 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dab42-b012-41d1-ab22-e9e830343681 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.566400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 277/583] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:14.567342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dab42-b012-41d1-ab22-e9e830343681 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.582763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1a32-4349-4c05-ae41-a3d52744f024 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.604375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.621226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2804be-1f5e-4a55-8dd5-3454b14aab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.621934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2804be-1f5e-4a55-8dd5-3454b14aab08 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.622289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2804be-1f5e-4a55-8dd5-3454b14aab08 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.622566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2804be-1f5e-4a55-8dd5-3454b14aab08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.633179 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2804be-1f5e-4a55-8dd5-3454b14aab08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.635781 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2804be-1f5e-4a55-8dd5-3454b14aab08 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7a2804be-1f5e-4a55-8dd5-3454b14aab08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:14.652928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:14.653923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:14.655667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:14.655667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:14.655667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:14.655667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 307/584] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:14.655667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2804be-1f5e-4a55-8dd5-3454b14aab08 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.685674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dab42-b012-41d1-ab22-e9e830343681 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.723707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc8bb8-ee83-4b13-afe6-2cd4f9af0ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.724472 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc8bb8-ee83-4b13-afe6-2cd4f9af0ecd None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.724761 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc8bb8-ee83-4b13-afe6-2cd4f9af0ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.726035 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc8bb8-ee83-4b13-afe6-2cd4f9af0ecd None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.726811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc8bb8-ee83-4b13-afe6-2cd4f9af0ecd None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:14.727179 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc8bb8-ee83-4b13-afe6-2cd4f9af0ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.728800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc8bb8-ee83-4b13-afe6-2cd4f9af0ecd None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.742186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 278/585] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:14.742849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc8bb8-ee83-4b13-afe6-2cd4f9af0ecd None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.772225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2804be-1f5e-4a55-8dd5-3454b14aab08 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.787609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.812717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16cb08-ca43-40c0-9fd2-f67b50ed2006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.813335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16cb08-ca43-40c0-9fd2-f67b50ed2006 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.813616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16cb08-ca43-40c0-9fd2-f67b50ed2006 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.813890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16cb08-ca43-40c0-9fd2-f67b50ed2006 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.814629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16cb08-ca43-40c0-9fd2-f67b50ed2006 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:14.814936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16cb08-ca43-40c0-9fd2-f67b50ed2006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.817922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16cb08-ca43-40c0-9fd2-f67b50ed2006 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.839991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 308/586] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:14.839991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16cb08-ca43-40c0-9fd2-f67b50ed2006 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.870543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc8bb8-ee83-4b13-afe6-2cd4f9af0ecd None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.871230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.913242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530b932-b51d-468c-bacc-4b8e1723c6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.913885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b932-b51d-468c-bacc-4b8e1723c6ff None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.914172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b932-b51d-468c-bacc-4b8e1723c6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.914449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b932-b51d-468c-bacc-4b8e1723c6ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.922644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530b932-b51d-468c-bacc-4b8e1723c6ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.924137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530b932-b51d-468c-bacc-4b8e1723c6ff None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-8530b932-b51d-468c-bacc-4b8e1723c6ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:14.939222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:14.940344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:14.941365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:14.941365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:14.941365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:14.941365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:14.941365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:14.941365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:14.941365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:14.941365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:14.941365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 279/587] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:14.941365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530b932-b51d-468c-bacc-4b8e1723c6ff None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.959558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16cb08-ca43-40c0-9fd2-f67b50ed2006 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.001675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6732-e6f8-458f-82df-4146e88afb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.002608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6732-e6f8-458f-82df-4146e88afb13 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.003194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6732-e6f8-458f-82df-4146e88afb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.003474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a6732-e6f8-458f-82df-4146e88afb13 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.004212 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6732-e6f8-458f-82df-4146e88afb13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:15.004528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6732-e6f8-458f-82df-4146e88afb13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.006043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a6732-e6f8-458f-82df-4146e88afb13 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.023933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 309/588] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:15.024694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6732-e6f8-458f-82df-4146e88afb13 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.050437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.055492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530b932-b51d-468c-bacc-4b8e1723c6ff None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.093148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bfa67-c1f2-4bc8-b290-04ff402008d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.093785 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfa67-c1f2-4bc8-b290-04ff402008d0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.094070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfa67-c1f2-4bc8-b290-04ff402008d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.094344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfa67-c1f2-4bc8-b290-04ff402008d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.105344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bfa67-c1f2-4bc8-b290-04ff402008d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.107097 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bfa67-c1f2-4bc8-b290-04ff402008d0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-616bfa67-c1f2-4bc8-b290-04ff402008d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:15.121703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:15.122665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:15.124334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:15.124334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:15.124334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:15.124508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.124580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 280/589] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:15.124580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bfa67-c1f2-4bc8-b290-04ff402008d0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.136353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a6732-e6f8-458f-82df-4146e88afb13 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.173725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382ecb1-8bb3-4a90-824c-4d324271e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.174358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ecb1-8bb3-4a90-824c-4d324271e35b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.174638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ecb1-8bb3-4a90-824c-4d324271e35b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.174916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382ecb1-8bb3-4a90-824c-4d324271e35b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.185190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382ecb1-8bb3-4a90-824c-4d324271e35b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.186793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382ecb1-8bb3-4a90-824c-4d324271e35b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-8382ecb1-8bb3-4a90-824c-4d324271e35b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:15.201784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:15.202891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:15.203885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:15.203885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:15.203885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:15.203885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 310/590] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:15.203885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382ecb1-8bb3-4a90-824c-4d324271e35b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.240786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bfa67-c1f2-4bc8-b290-04ff402008d0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.279829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d0c5a-0f1b-4e37-a706-7576d5946c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.280442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d0c5a-0f1b-4e37-a706-7576d5946c96 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.280724 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d0c5a-0f1b-4e37-a706-7576d5946c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.280995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d0c5a-0f1b-4e37-a706-7576d5946c96 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.281719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d0c5a-0f1b-4e37-a706-7576d5946c96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:15.281989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d0c5a-0f1b-4e37-a706-7576d5946c96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.283472 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d0c5a-0f1b-4e37-a706-7576d5946c96 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.296114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 281/591] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:15.296927 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d0c5a-0f1b-4e37-a706-7576d5946c96 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.312470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.322225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382ecb1-8bb3-4a90-824c-4d324271e35b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.358167 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3966dc-5491-4d1b-b025-8e6a7bae6d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.358951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3966dc-5491-4d1b-b025-8e6a7bae6d7c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.359335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3966dc-5491-4d1b-b025-8e6a7bae6d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.359682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3966dc-5491-4d1b-b025-8e6a7bae6d7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.366634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3966dc-5491-4d1b-b025-8e6a7bae6d7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.368197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3966dc-5491-4d1b-b025-8e6a7bae6d7c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-9d3966dc-5491-4d1b-b025-8e6a7bae6d7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:15.380292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:15.381376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:15.382451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:15.382451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:15.382451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:15.382451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:15.382451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:15.382451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:15.382451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:15.382451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:15.382451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 311/592] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:15.387253 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3966dc-5491-4d1b-b025-8e6a7bae6d7c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.390003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.411383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d0c5a-0f1b-4e37-a706-7576d5946c96 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.450417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42763fd0-c570-4da5-8356-6e1034d16f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.451071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763fd0-c570-4da5-8356-6e1034d16f7d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.451365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763fd0-c570-4da5-8356-6e1034d16f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.451887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763fd0-c570-4da5-8356-6e1034d16f7d None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.452295 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763fd0-c570-4da5-8356-6e1034d16f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:15.452603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763fd0-c570-4da5-8356-6e1034d16f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.453994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763fd0-c570-4da5-8356-6e1034d16f7d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.465511 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 282/593] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:15.470532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42763fd0-c570-4da5-8356-6e1034d16f7d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.494304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3966dc-5491-4d1b-b025-8e6a7bae6d7c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.530709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f94ae8-76a0-493e-ac2f-d4dba9dc936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.531638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f94ae8-76a0-493e-ac2f-d4dba9dc936e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.531920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f94ae8-76a0-493e-ac2f-d4dba9dc936e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.532198 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f94ae8-76a0-493e-ac2f-d4dba9dc936e None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.532848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f94ae8-76a0-493e-ac2f-d4dba9dc936e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:15.533154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f94ae8-76a0-493e-ac2f-d4dba9dc936e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.534551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f94ae8-76a0-493e-ac2f-d4dba9dc936e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.544771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.551784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 312/594] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:15.551784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f94ae8-76a0-493e-ac2f-d4dba9dc936e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.577692 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42763fd0-c570-4da5-8356-6e1034d16f7d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.615455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.617526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc250-9273-40e2-b7b6-635793d636dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.618196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc250-9273-40e2-b7b6-635793d636dc None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.618485 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc250-9273-40e2-b7b6-635793d636dc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.618768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc250-9273-40e2-b7b6-635793d636dc None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/6955fc5b81a040f686e21621ea968a6e/roles/09f0dc52983d44cfad84d8c3c4fc4384` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.633893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc250-9273-40e2-b7b6-635793d636dc None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=6955fc5b81a040f686e21621ea968a6e, role_id=09f0dc52983d44cfad84d8c3c4fc4384)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.635702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc250-9273-40e2-b7b6-635793d636dc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.655166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f94ae8-76a0-493e-ac2f-d4dba9dc936e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.689718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e19e9-a266-4086-a5e5-c7e1926ca619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.690322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e19e9-a266-4086-a5e5-c7e1926ca619 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.690604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e19e9-a266-4086-a5e5-c7e1926ca619 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.690885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e19e9-a266-4086-a5e5-c7e1926ca619 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.691608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e19e9-a266-4086-a5e5-c7e1926ca619 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:15.691914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e19e9-a266-4086-a5e5-c7e1926ca619 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.693354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e19e9-a266-4086-a5e5-c7e1926ca619 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.703356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 283/595] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:15 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/6955fc5b81a040f686e21621ea968a6e/roles/09f0dc52983d44cfad84d8c3c4fc4384 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:15.704521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc250-9273-40e2-b7b6-635793d636dc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.719033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 313/596] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:15.719033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e19e9-a266-4086-a5e5-c7e1926ca619 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.836730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc250-9273-40e2-b7b6-635793d636dc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.863908 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.871328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e19e9-a266-4086-a5e5-c7e1926ca619 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.880220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b2150-f063-43a5-909b-6e55d116c997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.881076 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b2150-f063-43a5-909b-6e55d116c997 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.881356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b2150-f063-43a5-909b-6e55d116c997 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.881631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b2150-f063-43a5-909b-6e55d116c997 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.889161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b2150-f063-43a5-909b-6e55d116c997 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.890626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b2150-f063-43a5-909b-6e55d116c997 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.903637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f93b2150-f063-43a5-909b-6e55d116c997 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:15.904051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:15.915292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 284/597] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:15.916445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b2150-f063-43a5-909b-6e55d116c997 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.920383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387a6dc-e931-4054-a36e-cbe8f6561b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.921025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387a6dc-e931-4054-a36e-cbe8f6561b87 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.921305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387a6dc-e931-4054-a36e-cbe8f6561b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.921593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387a6dc-e931-4054-a36e-cbe8f6561b87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.928944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387a6dc-e931-4054-a36e-cbe8f6561b87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.931798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387a6dc-e931-4054-a36e-cbe8f6561b87 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1387a6dc-e931-4054-a36e-cbe8f6561b87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:15.943134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:15.944234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:15.945116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:15.945116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:15.945116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:15.945116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:15.945116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:15.945116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:15.945116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:15.945116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:15.947310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 314/598] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:15.948703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b528-7ec0-40a2-a9fb-c0a4d7cf7258 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.948982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b528-7ec0-40a2-a9fb-c0a4d7cf7258 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.949257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b528-7ec0-40a2-a9fb-c0a4d7cf7258 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.950642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 315/599] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:15.951794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92b528-7ec0-40a2-a9fb-c0a4d7cf7258 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.025004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b2150-f063-43a5-909b-6e55d116c997 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.061800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2c6c9-f4a5-4a56-9b49-abbb0e0fac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.062461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2c6c9-f4a5-4a56-9b49-abbb0e0fac81 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.062740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2c6c9-f4a5-4a56-9b49-abbb0e0fac81 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.063071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2c6c9-f4a5-4a56-9b49-abbb0e0fac81 None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/9624bc4b2840420eb06d721a73655da4/roles/09f0dc52983d44cfad84d8c3c4fc4384` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.065110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92b528-7ec0-40a2-a9fb-c0a4d7cf7258 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.078119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2c6c9-f4a5-4a56-9b49-abbb0e0fac81 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=9624bc4b2840420eb06d721a73655da4, role_id=09f0dc52983d44cfad84d8c3c4fc4384)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.079602 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2c6c9-f4a5-4a56-9b49-abbb0e0fac81 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.099574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e229a1-fcb8-4942-aa0e-043bc1f33dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.100116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e229a1-fcb8-4942-aa0e-043bc1f33dcc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.100399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e229a1-fcb8-4942-aa0e-043bc1f33dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.100671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e229a1-fcb8-4942-aa0e-043bc1f33dcc None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.101410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e229a1-fcb8-4942-aa0e-043bc1f33dcc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:16.101720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e229a1-fcb8-4942-aa0e-043bc1f33dcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.103712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e229a1-fcb8-4942-aa0e-043bc1f33dcc None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.122831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 316/600] 10.222.0.88 () {56 vars in 1139 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:16.124031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e229a1-fcb8-4942-aa0e-043bc1f33dcc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.151294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 285/601] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:15 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/9624bc4b2840420eb06d721a73655da4/roles/09f0dc52983d44cfad84d8c3c4fc4384 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:16.158193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c43e1-4d4b-469e-808e-5f31fcf6bae1 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.158193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c43e1-4d4b-469e-808e-5f31fcf6bae1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.158193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c43e1-4d4b-469e-808e-5f31fcf6bae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.176747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.182225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c38c43e1-4d4b-469e-808e-5f31fcf6bae1 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:16.184217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c38c43e1-4d4b-469e-808e-5f31fcf6bae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:16.219446 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.254279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e229a1-fcb8-4942-aa0e-043bc1f33dcc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.275149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 286/602] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:16.276804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c43e1-4d4b-469e-808e-5f31fcf6bae1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.314042 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca30e0f-67a6-46a1-a042-cd201949c0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.314939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30e0f-67a6-46a1-a042-cd201949c0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.315637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30e0f-67a6-46a1-a042-cd201949c0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.316013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30e0f-67a6-46a1-a042-cd201949c0d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.317099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca30e0f-67a6-46a1-a042-cd201949c0d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:16.317508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca30e0f-67a6-46a1-a042-cd201949c0d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.319740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca30e0f-67a6-46a1-a042-cd201949c0d1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.339095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 317/603] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:16.342789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca30e0f-67a6-46a1-a042-cd201949c0d1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.421588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c43e1-4d4b-469e-808e-5f31fcf6bae1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.464111 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20b625-b3d1-4de2-b091-6b28b4cece96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.464752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20b625-b3d1-4de2-b091-6b28b4cece96 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.465039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20b625-b3d1-4de2-b091-6b28b4cece96 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.465318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20b625-b3d1-4de2-b091-6b28b4cece96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.465804 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.475353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca30e0f-67a6-46a1-a042-cd201949c0d1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.484089 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20b625-b3d1-4de2-b091-6b28b4cece96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.485942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20b625-b3d1-4de2-b091-6b28b4cece96 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.513515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ba683-e14e-4110-a1fb-d164f1bec8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.514272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ba683-e14e-4110-a1fb-d164f1bec8d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.514625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ba683-e14e-4110-a1fb-d164f1bec8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.514972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ba683-e14e-4110-a1fb-d164f1bec8d2 None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/380240bcfca240a2b4969f6618409a2f/roles/09f0dc52983d44cfad84d8c3c4fc4384` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-5e20b625-b3d1-4de2-b091-6b28b4cece96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:16.518524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:16.519562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:16.520482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:16.520482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:16.520482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:16.524066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 287/604] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:16.527132 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20b625-b3d1-4de2-b091-6b28b4cece96 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.533688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ba683-e14e-4110-a1fb-d164f1bec8d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=380240bcfca240a2b4969f6618409a2f, role_id=09f0dc52983d44cfad84d8c3c4fc4384)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.535522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ba683-e14e-4110-a1fb-d164f1bec8d2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.553954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.634693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 318/605] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:16 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/380240bcfca240a2b4969f6618409a2f/roles/09f0dc52983d44cfad84d8c3c4fc4384 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:16.635595 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ba683-e14e-4110-a1fb-d164f1bec8d2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.655255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20b625-b3d1-4de2-b091-6b28b4cece96 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.699082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416cfa0-06a3-4f93-9405-244f4b9de9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.700146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416cfa0-06a3-4f93-9405-244f4b9de9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.700691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416cfa0-06a3-4f93-9405-244f4b9de9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.701175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416cfa0-06a3-4f93-9405-244f4b9de9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.702180 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416cfa0-06a3-4f93-9405-244f4b9de9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:16.702735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416cfa0-06a3-4f93-9405-244f4b9de9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.704487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416cfa0-06a3-4f93-9405-244f4b9de9b7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.718655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 288/606] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:16.727603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416cfa0-06a3-4f93-9405-244f4b9de9b7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.775988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ba683-e14e-4110-a1fb-d164f1bec8d2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.809797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.818953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c06cd3-b4d4-402f-9908-0a34afc48ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.819648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c06cd3-b4d4-402f-9908-0a34afc48ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.819931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c06cd3-b4d4-402f-9908-0a34afc48ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.820205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c06cd3-b4d4-402f-9908-0a34afc48ca5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.833121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c06cd3-b4d4-402f-9908-0a34afc48ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b3c06cd3-b4d4-402f-9908-0a34afc48ca5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:16.838018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:16.838952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:16.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 319/607] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:16.845916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c06cd3-b4d4-402f-9908-0a34afc48ca5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.849972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416cfa0-06a3-4f93-9405-244f4b9de9b7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.860318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.892165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ba3db-551d-43bf-8f7a-8bed8d23a99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.893326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ba3db-551d-43bf-8f7a-8bed8d23a99a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.893819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ba3db-551d-43bf-8f7a-8bed8d23a99a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.894347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ba3db-551d-43bf-8f7a-8bed8d23a99a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.902283 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ba3db-551d-43bf-8f7a-8bed8d23a99a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.904149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ba3db-551d-43bf-8f7a-8bed8d23a99a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-523ba3db-551d-43bf-8f7a-8bed8d23a99a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:16.918492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:16.921030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:16.922115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:16.922115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:16.922115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:16.922115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:16.922115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:16.922115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:16.922115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:16.922115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:16.923123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 289/608] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:16.927451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ba3db-551d-43bf-8f7a-8bed8d23a99a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.961278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c06cd3-b4d4-402f-9908-0a34afc48ca5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.000001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a5f6e-3da9-45a9-a614-f7e67b55abad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.000622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a5f6e-3da9-45a9-a614-f7e67b55abad None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.000908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a5f6e-3da9-45a9-a614-f7e67b55abad None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.001187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a5f6e-3da9-45a9-a614-f7e67b55abad None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.001979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a5f6e-3da9-45a9-a614-f7e67b55abad None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:17.002294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a5f6e-3da9-45a9-a614-f7e67b55abad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.004788 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a5f6e-3da9-45a9-a614-f7e67b55abad None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.014581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 320/609] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:17.020112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a5f6e-3da9-45a9-a614-f7e67b55abad None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.039842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ba3db-551d-43bf-8f7a-8bed8d23a99a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.077881 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:17.085214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623ca4-4bbb-4f6c-930a-fe097a0f3f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.086079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623ca4-4bbb-4f6c-930a-fe097a0f3f91 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.086362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623ca4-4bbb-4f6c-930a-fe097a0f3f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.087090 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623ca4-4bbb-4f6c-930a-fe097a0f3f91 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.088138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623ca4-4bbb-4f6c-930a-fe097a0f3f91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:17.088453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623ca4-4bbb-4f6c-930a-fe097a0f3f91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.090540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623ca4-4bbb-4f6c-930a-fe097a0f3f91 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.099348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:17.106960 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 290/610] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:17.112522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623ca4-4bbb-4f6c-930a-fe097a0f3f91 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.181053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a5f6e-3da9-45a9-a614-f7e67b55abad None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.227818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623ca4-4bbb-4f6c-930a-fe097a0f3f91 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.265585 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bd2ba-7eb1-4ea1-a3ae-8a0cb8a406fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.266859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bd2ba-7eb1-4ea1-a3ae-8a0cb8a406fa None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.267218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bd2ba-7eb1-4ea1-a3ae-8a0cb8a406fa None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.267790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bd2ba-7eb1-4ea1-a3ae-8a0cb8a406fa None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/b4ab7a3b191e4a0b84b396cafa8a9ff7/roles/09f0dc52983d44cfad84d8c3c4fc4384` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.285500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bd2ba-7eb1-4ea1-a3ae-8a0cb8a406fa None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=b4ab7a3b191e4a0b84b396cafa8a9ff7, role_id=09f0dc52983d44cfad84d8c3c4fc4384)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.287241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bd2ba-7eb1-4ea1-a3ae-8a0cb8a406fa None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.294756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5bb63-31bd-42b4-bf26-f8e9ac290caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.295522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5bb63-31bd-42b4-bf26-f8e9ac290caf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.295875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5bb63-31bd-42b4-bf26-f8e9ac290caf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.296222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5bb63-31bd-42b4-bf26-f8e9ac290caf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.309109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5bb63-31bd-42b4-bf26-f8e9ac290caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.310693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5bb63-31bd-42b4-bf26-f8e9ac290caf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f7e5bb63-31bd-42b4-bf26-f8e9ac290caf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:17.326248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:17.328835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:17.329841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:17.329841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:17.329841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:17.329841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 321/611] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:17.333391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5bb63-31bd-42b4-bf26-f8e9ac290caf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.355228 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 291/612] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:17 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/b4ab7a3b191e4a0b84b396cafa8a9ff7/roles/09f0dc52983d44cfad84d8c3c4fc4384 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:17.454639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5bb63-31bd-42b4-bf26-f8e9ac290caf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.482429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:17.493480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac48d4-016c-420b-b791-b4d3b0c2fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.494242 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac48d4-016c-420b-b791-b4d3b0c2fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.494597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac48d4-016c-420b-b791-b4d3b0c2fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.494945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac48d4-016c-420b-b791-b4d3b0c2fdb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.495724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac48d4-016c-420b-b791-b4d3b0c2fdb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:17.496110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac48d4-016c-420b-b791-b4d3b0c2fdb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.497590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac48d4-016c-420b-b791-b4d3b0c2fdb7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.512243 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 322/613] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:17.517942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bd2ba-7eb1-4ea1-a3ae-8a0cb8a406fa None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.565384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:17.626911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bd2ba-7eb1-4ea1-a3ae-8a0cb8a406fa None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.663106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48f40b-30e1-4525-aa00-a22c57a8f21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.663784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f40b-30e1-4525-aa00-a22c57a8f21b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.664036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f40b-30e1-4525-aa00-a22c57a8f21b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.664303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48f40b-30e1-4525-aa00-a22c57a8f21b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.673250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48f40b-30e1-4525-aa00-a22c57a8f21b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.674744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48f40b-30e1-4525-aa00-a22c57a8f21b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-9d48f40b-30e1-4525-aa00-a22c57a8f21b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:17.687434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:17.688584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:17.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:17.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:17.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:17.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:17.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:17.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:17.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:17.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:17.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:17.689725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:17.692168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 292/614] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:17.698369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac48d4-016c-420b-b791-b4d3b0c2fdb7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.805951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac48d4-016c-420b-b791-b4d3b0c2fdb7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.851766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7b488-ce70-43dc-869d-b18aa87ef995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.852492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7b488-ce70-43dc-869d-b18aa87ef995 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.852850 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7b488-ce70-43dc-869d-b18aa87ef995 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.853760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7b488-ce70-43dc-869d-b18aa87ef995 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.854546 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7b488-ce70-43dc-869d-b18aa87ef995 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:17.854929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7b488-ce70-43dc-869d-b18aa87ef995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.856734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7b488-ce70-43dc-869d-b18aa87ef995 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.875889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 323/615] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:17.881528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48f40b-30e1-4525-aa00-a22c57a8f21b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.987289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ca8e-32a5-473d-9d34-7f1c36601a43 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.987847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ca8e-32a5-473d-9d34-7f1c36601a43 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.988101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ca8e-32a5-473d-9d34-7f1c36601a43 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.989305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48f40b-30e1-4525-aa00-a22c57a8f21b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.989884 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 324/616] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:17.991572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:17.997614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ec84f-c0a8-42d6-8e16-72f20d316858 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.998010 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ec84f-c0a8-42d6-8e16-72f20d316858 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.998386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ec84f-c0a8-42d6-8e16-72f20d316858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.019510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-419ec84f-c0a8-42d6-8e16-72f20d316858 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:18.020864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-419ec84f-c0a8-42d6-8e16-72f20d316858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:18.052087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef51e62-27a4-4b2b-86a3-d11cf458e93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.052993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef51e62-27a4-4b2b-86a3-d11cf458e93e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.053430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef51e62-27a4-4b2b-86a3-d11cf458e93e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.053857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef51e62-27a4-4b2b-86a3-d11cf458e93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.066115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.081206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef51e62-27a4-4b2b-86a3-d11cf458e93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.082683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef51e62-27a4-4b2b-86a3-d11cf458e93e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.100214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 325/617] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-9ef51e62-27a4-4b2b-86a3-d11cf458e93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:18.110113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:18.111390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:18.112362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:18.112362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:18.112362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:18.112362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 293/618] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:18.119992 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ec84f-c0a8-42d6-8e16-72f20d316858 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.235577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ec84f-c0a8-42d6-8e16-72f20d316858 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.271734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d22f03-3940-4af0-8197-68a03f1264c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.272350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22f03-3940-4af0-8197-68a03f1264c5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.272633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22f03-3940-4af0-8197-68a03f1264c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.272908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22f03-3940-4af0-8197-68a03f1264c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.274407 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d22f03-3940-4af0-8197-68a03f1264c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:18.274711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d22f03-3940-4af0-8197-68a03f1264c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.276181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d22f03-3940-4af0-8197-68a03f1264c5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.289209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 326/619] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:18.296137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef51e62-27a4-4b2b-86a3-d11cf458e93e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.457824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef51e62-27a4-4b2b-86a3-d11cf458e93e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.485188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d22f03-3940-4af0-8197-68a03f1264c5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.503119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04469f7e-6767-4604-980d-25d00ad63ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.503755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469f7e-6767-4604-980d-25d00ad63ecb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.504034 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469f7e-6767-4604-980d-25d00ad63ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.504305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469f7e-6767-4604-980d-25d00ad63ecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.519190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04469f7e-6767-4604-980d-25d00ad63ecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.520642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04469f7e-6767-4604-980d-25d00ad63ecb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-04469f7e-6767-4604-980d-25d00ad63ecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:18.540016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:18.541490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:18.542390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:18.542390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:18.542390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:18.542390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:18.542390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:18.542390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:18.542390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:18.542390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:18.542843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 294/620] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:18.548082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04469f7e-6767-4604-980d-25d00ad63ecb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.569286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.572924 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.659245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04469f7e-6767-4604-980d-25d00ad63ecb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.678874 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d22f03-3940-4af0-8197-68a03f1264c5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.703286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35075ae6-d7be-4cfe-81f3-b4c5d2c7e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.704048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35075ae6-d7be-4cfe-81f3-b4c5d2c7e60b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.704650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35075ae6-d7be-4cfe-81f3-b4c5d2c7e60b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.704928 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35075ae6-d7be-4cfe-81f3-b4c5d2c7e60b None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.705899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35075ae6-d7be-4cfe-81f3-b4c5d2c7e60b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:18.706208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35075ae6-d7be-4cfe-81f3-b4c5d2c7e60b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.708459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35075ae6-d7be-4cfe-81f3-b4c5d2c7e60b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.715671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b5b06-42e2-4728-997d-3a76537c5201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.716437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b5b06-42e2-4728-997d-3a76537c5201 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.716794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b5b06-42e2-4728-997d-3a76537c5201 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.717221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b5b06-42e2-4728-997d-3a76537c5201 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.723858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 295/621] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:18.725269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2845-aad3-451a-9583-c13d84da048e None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.725844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2845-aad3-451a-9583-c13d84da048e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.726122 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2845-aad3-451a-9583-c13d84da048e None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.727372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 296/622] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:18.729484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f2845-aad3-451a-9583-c13d84da048e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.730697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b5b06-42e2-4728-997d-3a76537c5201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c37b5b06-42e2-4728-997d-3a76537c5201 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:18.740047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:18.741048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:18.741915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 327/623] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:18.743181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61e3d2-0090-498b-a966-979c777330ce None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.743344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61e3d2-0090-498b-a966-979c777330ce None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.747088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61e3d2-0090-498b-a966-979c777330ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.767266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7c61e3d2-0090-498b-a966-979c777330ce None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:18.769052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c61e3d2-0090-498b-a966-979c777330ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:18.824545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.852161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f2845-aad3-451a-9583-c13d84da048e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.879201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 328/624] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:18.880382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61e3d2-0090-498b-a966-979c777330ce None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.895499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93036e47-e1f7-48f0-bafe-1e1560d49867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.896849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036e47-e1f7-48f0-bafe-1e1560d49867 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.897357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036e47-e1f7-48f0-bafe-1e1560d49867 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.897854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93036e47-e1f7-48f0-bafe-1e1560d49867 None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/d4052d31496a46948211cd4b7d38808b/roles/09f0dc52983d44cfad84d8c3c4fc4384` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.916356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93036e47-e1f7-48f0-bafe-1e1560d49867 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=d4052d31496a46948211cd4b7d38808b, role_id=09f0dc52983d44cfad84d8c3c4fc4384)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.918378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93036e47-e1f7-48f0-bafe-1e1560d49867 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.921956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.012233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 297/625] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:18 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/d4052d31496a46948211cd4b7d38808b/roles/09f0dc52983d44cfad84d8c3c4fc4384 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:19.026335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61e3d2-0090-498b-a966-979c777330ce None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.081043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c72a-dd01-43c6-9468-b0b4f30c7c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.082078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c72a-dd01-43c6-9468-b0b4f30c7c12 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.082571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c72a-dd01-43c6-9468-b0b4f30c7c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.083070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c72a-dd01-43c6-9468-b0b4f30c7c12 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.083980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c72a-dd01-43c6-9468-b0b4f30c7c12 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:19.084519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c72a-dd01-43c6-9468-b0b4f30c7c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:19.086133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c72a-dd01-43c6-9468-b0b4f30c7c12 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:19.100145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 329/626] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:19.106715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93036e47-e1f7-48f0-bafe-1e1560d49867 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.224408 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c72a-dd01-43c6-9468-b0b4f30c7c12 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.262533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93036e47-e1f7-48f0-bafe-1e1560d49867 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.290290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.307417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a06bb5-d4a8-4f89-9653-3e7b7ca7c589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.309011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a06bb5-d4a8-4f89-9653-3e7b7ca7c589 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.309011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a06bb5-d4a8-4f89-9653-3e7b7ca7c589 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.321994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a06bb5-d4a8-4f89-9653-3e7b7ca7c589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.321994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a06bb5-d4a8-4f89-9653-3e7b7ca7c589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:19.321994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a06bb5-d4a8-4f89-9653-3e7b7ca7c589 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-52a06bb5-d4a8-4f89-9653-3e7b7ca7c589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:19.341694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:19.342811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:19.343746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:19.343746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:19.343746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:19.347194 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 298/627] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:19.349519 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41118-4bae-4c63-bfd4-83623f3a7f28 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.349806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41118-4bae-4c63-bfd4-83623f3a7f28 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.350084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41118-4bae-4c63-bfd4-83623f3a7f28 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.351595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 299/628] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:19.356662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d41118-4bae-4c63-bfd4-83623f3a7f28 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.357137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.379759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c72a-dd01-43c6-9468-b0b4f30c7c12 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.418068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ad690-3f30-4f75-9d60-0bc4769f3155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.419016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ad690-3f30-4f75-9d60-0bc4769f3155 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.419512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ad690-3f30-4f75-9d60-0bc4769f3155 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.419962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ad690-3f30-4f75-9d60-0bc4769f3155 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.438289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ad690-3f30-4f75-9d60-0bc4769f3155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-e20ad690-3f30-4f75-9d60-0bc4769f3155 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:19.443157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:19.444105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:19.444968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:19.449157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 330/629] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:19.450431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b30590-8202-4d6f-99af-9cbdcac2feea None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.450720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b30590-8202-4d6f-99af-9cbdcac2feea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.450999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b30590-8202-4d6f-99af-9cbdcac2feea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.469839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f2b30590-8202-4d6f-99af-9cbdcac2feea None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:19.471306 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f2b30590-8202-4d6f-99af-9cbdcac2feea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:19.501855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d41118-4bae-4c63-bfd4-83623f3a7f28 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.545127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 331/630] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:19.546108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b30590-8202-4d6f-99af-9cbdcac2feea None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.547795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02224bb7-e034-47aa-a26a-bc10218c24b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.548799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224bb7-e034-47aa-a26a-bc10218c24b3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.549282 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224bb7-e034-47aa-a26a-bc10218c24b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.550557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02224bb7-e034-47aa-a26a-bc10218c24b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.551451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02224bb7-e034-47aa-a26a-bc10218c24b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:19.551943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02224bb7-e034-47aa-a26a-bc10218c24b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:19.553500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02224bb7-e034-47aa-a26a-bc10218c24b3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:19.569301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 300/631] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:19.575570 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02224bb7-e034-47aa-a26a-bc10218c24b3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.630822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.665314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.717462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b30590-8202-4d6f-99af-9cbdcac2feea None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.755500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02224bb7-e034-47aa-a26a-bc10218c24b3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.776555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42398f2d-3bd7-4e40-a63c-58a7257f3be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.777661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42398f2d-3bd7-4e40-a63c-58a7257f3be4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.778265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42398f2d-3bd7-4e40-a63c-58a7257f3be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.778746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42398f2d-3bd7-4e40-a63c-58a7257f3be4 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.779672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42398f2d-3bd7-4e40-a63c-58a7257f3be4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:19.780200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42398f2d-3bd7-4e40-a63c-58a7257f3be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:19.787567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42398f2d-3bd7-4e40-a63c-58a7257f3be4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:19.792382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ece970-8ed8-4cab-a20e-0643370b0c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.793019 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece970-8ed8-4cab-a20e-0643370b0c0b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.793297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece970-8ed8-4cab-a20e-0643370b0c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.793569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece970-8ed8-4cab-a20e-0643370b0c0b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.807244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 332/632] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:19.811824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ece970-8ed8-4cab-a20e-0643370b0c0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:19.813309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ece970-8ed8-4cab-a20e-0643370b0c0b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:19.817511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6be83a-fc68-46ed-bb8f-0764f174b5e3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.817801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6be83a-fc68-46ed-bb8f-0764f174b5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.818078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6be83a-fc68-46ed-bb8f-0764f174b5e3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.819644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 333/633] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:19.824458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6be83a-fc68-46ed-bb8f-0764f174b5e3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-22ece970-8ed8-4cab-a20e-0643370b0c0b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:19.827617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:19.828649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:19.829718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:19.829718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:19.829718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:19.829718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:19.829718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:19.829718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:19.829718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:19.829718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:19.829718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:27:19.829718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:19.829718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 301/634] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:19.830651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dca339-9d99-4a97-be86-f02a1a5ada16 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.830651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dca339-9d99-4a97-be86-f02a1a5ada16 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.830823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dca339-9d99-4a97-be86-f02a1a5ada16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.851322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-89dca339-9d99-4a97-be86-f02a1a5ada16 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:19.852534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-89dca339-9d99-4a97-be86-f02a1a5ada16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:19.944213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 302/635] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:19.945523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dca339-9d99-4a97-be86-f02a1a5ada16 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.952541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6be83a-fc68-46ed-bb8f-0764f174b5e3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.983873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.988478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abae2c-9e99-41b6-9783-8f2a1dec3849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.989164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abae2c-9e99-41b6-9783-8f2a1dec3849 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.989445 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abae2c-9e99-41b6-9783-8f2a1dec3849 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.989721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abae2c-9e99-41b6-9783-8f2a1dec3849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.992957 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.001259 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abae2c-9e99-41b6-9783-8f2a1dec3849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.002719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abae2c-9e99-41b6-9783-8f2a1dec3849 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-67abae2c-9e99-41b6-9783-8f2a1dec3849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:20.018293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:20.019316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:20.020203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:20.020203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:20.020203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:20.023485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 334/636] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:20.024326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abae2c-9e99-41b6-9783-8f2a1dec3849 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.081989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dca339-9d99-4a97-be86-f02a1a5ada16 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.132221 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa1fb-dc82-42bd-9fc3-e41553977f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.133635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa1fb-dc82-42bd-9fc3-e41553977f45 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.134168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa1fb-dc82-42bd-9fc3-e41553977f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.134641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa1fb-dc82-42bd-9fc3-e41553977f45 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.136189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aa1fb-dc82-42bd-9fc3-e41553977f45 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:20.136665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aa1fb-dc82-42bd-9fc3-e41553977f45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.138831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aa1fb-dc82-42bd-9fc3-e41553977f45 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.142124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abae2c-9e99-41b6-9783-8f2a1dec3849 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.167848 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 303/637] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:20.169240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa1fb-dc82-42bd-9fc3-e41553977f45 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.185609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6ce8e-633f-41ac-b29c-e8389963f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.186416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6ce8e-633f-41ac-b29c-e8389963f682 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.186920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6ce8e-633f-41ac-b29c-e8389963f682 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.187192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6ce8e-633f-41ac-b29c-e8389963f682 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.198783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6ce8e-633f-41ac-b29c-e8389963f682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-24f6ce8e-633f-41ac-b29c-e8389963f682 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:20.205372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:20.206502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:20.207562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 335/638] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:20.208408 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6ce8e-633f-41ac-b29c-e8389963f682 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.269108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.274439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.290982 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa1fb-dc82-42bd-9fc3-e41553977f45 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.324455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6ce8e-633f-41ac-b29c-e8389963f682 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.330198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db46c5-09e8-4ba6-9b1d-99b753aea7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.330835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db46c5-09e8-4ba6-9b1d-99b753aea7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.331151 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db46c5-09e8-4ba6-9b1d-99b753aea7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.331432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db46c5-09e8-4ba6-9b1d-99b753aea7d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.332202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db46c5-09e8-4ba6-9b1d-99b753aea7d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:20.332446 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db46c5-09e8-4ba6-9b1d-99b753aea7d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.334559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db46c5-09e8-4ba6-9b1d-99b753aea7d2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.348648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 304/639] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:20.349807 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db46c5-09e8-4ba6-9b1d-99b753aea7d2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.367211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc98b6-0ab6-40b8-86ef-758615c4dd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.367957 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc98b6-0ab6-40b8-86ef-758615c4dd19 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.368295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc98b6-0ab6-40b8-86ef-758615c4dd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.369158 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc98b6-0ab6-40b8-86ef-758615c4dd19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.448069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc98b6-0ab6-40b8-86ef-758615c4dd19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.449605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc98b6-0ab6-40b8-86ef-758615c4dd19 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.470020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db46c5-09e8-4ba6-9b1d-99b753aea7d2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.500216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.505772 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922adb0-5437-4457-952d-14515ca9db9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.511127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922adb0-5437-4457-952d-14515ca9db9f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.511127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922adb0-5437-4457-952d-14515ca9db9f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.511127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922adb0-5437-4457-952d-14515ca9db9f None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.511127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922adb0-5437-4457-952d-14515ca9db9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:20.511127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922adb0-5437-4457-952d-14515ca9db9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.511127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922adb0-5437-4457-952d-14515ca9db9f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.519403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 305/640] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:20.520220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922adb0-5437-4457-952d-14515ca9db9f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.532859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.567924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 336/641] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:20.567924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc98b6-0ab6-40b8-86ef-758615c4dd19 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.632269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922adb0-5437-4457-952d-14515ca9db9f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.667634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16b827-fb72-4c04-8ca1-282b8b103b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.668264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16b827-fb72-4c04-8ca1-282b8b103b28 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.668544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16b827-fb72-4c04-8ca1-282b8b103b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.668858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16b827-fb72-4c04-8ca1-282b8b103b28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.669960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc98b6-0ab6-40b8-86ef-758615c4dd19 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.679117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16b827-fb72-4c04-8ca1-282b8b103b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-5a16b827-fb72-4c04-8ca1-282b8b103b28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:20.684390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:20.685362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:20.686199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 306/642] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:20.686898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16b827-fb72-4c04-8ca1-282b8b103b28 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.709134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd55db-4533-4e71-8186-2b874ac2f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.709775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd55db-4533-4e71-8186-2b874ac2f8ea None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.710056 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd55db-4533-4e71-8186-2b874ac2f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.710546 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd55db-4533-4e71-8186-2b874ac2f8ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.718632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd55db-4533-4e71-8186-2b874ac2f8ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.720249 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd55db-4533-4e71-8186-2b874ac2f8ea None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c0bd55db-4533-4e71-8186-2b874ac2f8ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:20.732068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:20.733108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 337/643] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:20.734077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd55db-4533-4e71-8186-2b874ac2f8ea None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.748051 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.762343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.806760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16b827-fb72-4c04-8ca1-282b8b103b28 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.848040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fdd20-3c92-47cb-9254-2fd99a45612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.848702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fdd20-3c92-47cb-9254-2fd99a45612f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.848986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fdd20-3c92-47cb-9254-2fd99a45612f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.849266 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fdd20-3c92-47cb-9254-2fd99a45612f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.854503 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd55db-4533-4e71-8186-2b874ac2f8ea None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.861220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fdd20-3c92-47cb-9254-2fd99a45612f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.862932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fdd20-3c92-47cb-9254-2fd99a45612f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-e30fdd20-3c92-47cb-9254-2fd99a45612f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:20.882489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:20.883504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:20.885136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:20.885136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:20.885136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:20.885136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 307/644] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:20.885136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fdd20-3c92-47cb-9254-2fd99a45612f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.896716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bbb1e-c611-4792-b68d-59794723c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.897359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bbb1e-c611-4792-b68d-59794723c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.897644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bbb1e-c611-4792-b68d-59794723c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.898049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bbb1e-c611-4792-b68d-59794723c7d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.909870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bbb1e-c611-4792-b68d-59794723c7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.911513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bbb1e-c611-4792-b68d-59794723c7d5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cb3bbb1e-c611-4792-b68d-59794723c7d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:20.927356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:20.928368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:20.929278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:20.929278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:20.929278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:20.929278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 338/645] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:20.929967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bbb1e-c611-4792-b68d-59794723c7d5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.996678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.002601 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fdd20-3c92-47cb-9254-2fd99a45612f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.021763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.039298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc75274-58a3-4af4-a03a-db8e702cd6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.040144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc75274-58a3-4af4-a03a-db8e702cd6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.040456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc75274-58a3-4af4-a03a-db8e702cd6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.040731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc75274-58a3-4af4-a03a-db8e702cd6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.041397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc75274-58a3-4af4-a03a-db8e702cd6e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.041497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bbb1e-c611-4792-b68d-59794723c7d5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.041703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc75274-58a3-4af4-a03a-db8e702cd6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.043142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc75274-58a3-4af4-a03a-db8e702cd6e5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.051725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 308/646] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.057046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc75274-58a3-4af4-a03a-db8e702cd6e5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.078516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac24d0-a632-4af2-af9d-14145d8a1095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.079166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac24d0-a632-4af2-af9d-14145d8a1095 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.079454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac24d0-a632-4af2-af9d-14145d8a1095 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.079732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac24d0-a632-4af2-af9d-14145d8a1095 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.080471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac24d0-a632-4af2-af9d-14145d8a1095 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.080786 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac24d0-a632-4af2-af9d-14145d8a1095 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.082238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac24d0-a632-4af2-af9d-14145d8a1095 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.100655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 339/647] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.101734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac24d0-a632-4af2-af9d-14145d8a1095 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.170831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc75274-58a3-4af4-a03a-db8e702cd6e5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.204900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573adf5-76c5-43fa-adb5-30bf6d8cd77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.205512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573adf5-76c5-43fa-adb5-30bf6d8cd77e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.205798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573adf5-76c5-43fa-adb5-30bf6d8cd77e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.206109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573adf5-76c5-43fa-adb5-30bf6d8cd77e None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.206756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573adf5-76c5-43fa-adb5-30bf6d8cd77e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.207087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573adf5-76c5-43fa-adb5-30bf6d8cd77e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.208467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573adf5-76c5-43fa-adb5-30bf6d8cd77e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.213274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac24d0-a632-4af2-af9d-14145d8a1095 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.220086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 309/648] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.220899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573adf5-76c5-43fa-adb5-30bf6d8cd77e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.234051 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.250597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856d6c6-2aa7-4b7b-8a05-3e0ad437cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.251244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856d6c6-2aa7-4b7b-8a05-3e0ad437cde5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.251524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856d6c6-2aa7-4b7b-8a05-3e0ad437cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.251800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856d6c6-2aa7-4b7b-8a05-3e0ad437cde5 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.252451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856d6c6-2aa7-4b7b-8a05-3e0ad437cde5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.252759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856d6c6-2aa7-4b7b-8a05-3e0ad437cde5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.254154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856d6c6-2aa7-4b7b-8a05-3e0ad437cde5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.263804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.265879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 340/649] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.266739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856d6c6-2aa7-4b7b-8a05-3e0ad437cde5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.322454 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573adf5-76c5-43fa-adb5-30bf6d8cd77e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.357139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c5c16-e193-488f-9ffd-28ed9b93a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.357768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5c16-e193-488f-9ffd-28ed9b93a8ca None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.358052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5c16-e193-488f-9ffd-28ed9b93a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.358330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5c16-e193-488f-9ffd-28ed9b93a8ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.368314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856d6c6-2aa7-4b7b-8a05-3e0ad437cde5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.369340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c5c16-e193-488f-9ffd-28ed9b93a8ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.370790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c5c16-e193-488f-9ffd-28ed9b93a8ca None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-818c5c16-e193-488f-9ffd-28ed9b93a8ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:21.384656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:21.385759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:21.386967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:21.386967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:21.386967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:21.386967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 310/650] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:21.386967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670be2cb-160f-464d-88c1-310bb7b29cbb None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.387395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670be2cb-160f-464d-88c1-310bb7b29cbb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.387477 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670be2cb-160f-464d-88c1-310bb7b29cbb None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.391091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 311/651] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:21.391091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670be2cb-160f-464d-88c1-310bb7b29cbb None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.405074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5476d3-2474-4780-a3ca-26aaaa533fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.405686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5476d3-2474-4780-a3ca-26aaaa533fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.405970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5476d3-2474-4780-a3ca-26aaaa533fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.406270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5476d3-2474-4780-a3ca-26aaaa533fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.452622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.473690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5476d3-2474-4780-a3ca-26aaaa533fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.475302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5476d3-2474-4780-a3ca-26aaaa533fc4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.483970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.493685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670be2cb-160f-464d-88c1-310bb7b29cbb None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.528004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aa09c-77ed-4ea6-9dd3-2fa2590f56c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.528633 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aa09c-77ed-4ea6-9dd3-2fa2590f56c6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.528917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aa09c-77ed-4ea6-9dd3-2fa2590f56c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.529224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aa09c-77ed-4ea6-9dd3-2fa2590f56c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.538132 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54aa09c-77ed-4ea6-9dd3-2fa2590f56c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.539610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54aa09c-77ed-4ea6-9dd3-2fa2590f56c6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-a54aa09c-77ed-4ea6-9dd3-2fa2590f56c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:21.551450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:21.552593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 312/652] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:21.553755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aa09c-77ed-4ea6-9dd3-2fa2590f56c6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.580580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 341/653] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:21.581474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5476d3-2474-4780-a3ca-26aaaa533fc4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.657478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aa09c-77ed-4ea6-9dd3-2fa2590f56c6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.661131 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.683824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5476d3-2474-4780-a3ca-26aaaa533fc4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.691015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db408de9-ba9e-4d1e-8278-ae6652783795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.691660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db408de9-ba9e-4d1e-8278-ae6652783795 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.691938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db408de9-ba9e-4d1e-8278-ae6652783795 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.692208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db408de9-ba9e-4d1e-8278-ae6652783795 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.698751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db408de9-ba9e-4d1e-8278-ae6652783795 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.700225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db408de9-ba9e-4d1e-8278-ae6652783795 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-db408de9-ba9e-4d1e-8278-ae6652783795 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:21.711830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:21.713352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:21.714252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:21.714252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:21.714252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:21.714252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:21.714252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:21.714252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:21.714252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:21.714252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:21.714252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 313/654] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:21.716328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b9917-c017-4476-bb94-949cf81144c9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.716615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b9917-c017-4476-bb94-949cf81144c9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.716894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b9917-c017-4476-bb94-949cf81144c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.718752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef95b5-ca20-4133-8c1f-e409d93cef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.719401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef95b5-ca20-4133-8c1f-e409d93cef52 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.719672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef95b5-ca20-4133-8c1f-e409d93cef52 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.719943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef95b5-ca20-4133-8c1f-e409d93cef52 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.720583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef95b5-ca20-4133-8c1f-e409d93cef52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.720885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef95b5-ca20-4133-8c1f-e409d93cef52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.722246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef95b5-ca20-4133-8c1f-e409d93cef52 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.734556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 342/655] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.735245 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef95b5-ca20-4133-8c1f-e409d93cef52 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.736340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-455b9917-c017-4476-bb94-949cf81144c9 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:21.737550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-455b9917-c017-4476-bb94-949cf81144c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:21.745537 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.804538 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 314/656] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:21.805470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b9917-c017-4476-bb94-949cf81144c9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.848273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef95b5-ca20-4133-8c1f-e409d93cef52 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.887399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8c240-cc49-4c0a-8e8f-455073d37d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.888012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8c240-cc49-4c0a-8e8f-455073d37d99 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.888295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8c240-cc49-4c0a-8e8f-455073d37d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.888567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8c240-cc49-4c0a-8e8f-455073d37d99 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.889301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8c240-cc49-4c0a-8e8f-455073d37d99 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.889609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8c240-cc49-4c0a-8e8f-455073d37d99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.891098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8c240-cc49-4c0a-8e8f-455073d37d99 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.899967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.908974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 343/657] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.909840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8c240-cc49-4c0a-8e8f-455073d37d99 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.919507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b9917-c017-4476-bb94-949cf81144c9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.955596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aadce-0b0c-43a1-a0b2-adc280f74b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.956229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aadce-0b0c-43a1-a0b2-adc280f74b8c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.956514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aadce-0b0c-43a1-a0b2-adc280f74b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.956786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aadce-0b0c-43a1-a0b2-adc280f74b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.967195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aadce-0b0c-43a1-a0b2-adc280f74b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.968589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aadce-0b0c-43a1-a0b2-adc280f74b8c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.970511 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-827aadce-0b0c-43a1-a0b2-adc280f74b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:21.984328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:21.985395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:21.986280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:21.986280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:21.986280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:21.990621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 315/658] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:21.991588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aadce-0b0c-43a1-a0b2-adc280f74b8c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.015559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8c240-cc49-4c0a-8e8f-455073d37d99 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.052652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ac793-7073-453d-a56a-9d73023193b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.053369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ac793-7073-453d-a56a-9d73023193b6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.053713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ac793-7073-453d-a56a-9d73023193b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.054044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ac793-7073-453d-a56a-9d73023193b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.054806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ac793-7073-453d-a56a-9d73023193b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:22.055406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ac793-7073-453d-a56a-9d73023193b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.057365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ac793-7073-453d-a56a-9d73023193b6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.068962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 344/659] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:22.069881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ac793-7073-453d-a56a-9d73023193b6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.106607 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aadce-0b0c-43a1-a0b2-adc280f74b8c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.127254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.140113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9b42d-5474-4678-bf3c-4a3d442cd2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.140753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9b42d-5474-4678-bf3c-4a3d442cd2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.141018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9b42d-5474-4678-bf3c-4a3d442cd2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.141361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9b42d-5474-4678-bf3c-4a3d442cd2b5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.149009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9b42d-5474-4678-bf3c-4a3d442cd2b5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.150579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9b42d-5474-4678-bf3c-4a3d442cd2b5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-eda9b42d-5474-4678-bf3c-4a3d442cd2b5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:22.161494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:22.162631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:22.163884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:22.163884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:22.163884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:22.163884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:22.163884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:22.163884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:22.163884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:22.163884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:22.163884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:27:22.163884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:22.167328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 316/660] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:22.168183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9b42d-5474-4678-bf3c-4a3d442cd2b5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.172493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ac793-7073-453d-a56a-9d73023193b6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.206168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e054a-249f-4405-b35d-2bf6a716aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.206776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e054a-249f-4405-b35d-2bf6a716aa6a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.207068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e054a-249f-4405-b35d-2bf6a716aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.207369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e054a-249f-4405-b35d-2bf6a716aa6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.222387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.269526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9b42d-5474-4678-bf3c-4a3d442cd2b5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.277177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e054a-249f-4405-b35d-2bf6a716aa6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.278654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e054a-249f-4405-b35d-2bf6a716aa6a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.303273 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b55bf-e51a-485c-bade-bdc1327b8fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.303873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b55bf-e51a-485c-bade-bdc1327b8fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.304150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b55bf-e51a-485c-bade-bdc1327b8fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.304417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b55bf-e51a-485c-bade-bdc1327b8fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.305059 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b55bf-e51a-485c-bade-bdc1327b8fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:22.305361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b55bf-e51a-485c-bade-bdc1327b8fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.307341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b55bf-e51a-485c-bade-bdc1327b8fc6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.319170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 317/661] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:22.319977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b55bf-e51a-485c-bade-bdc1327b8fc6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.332889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.377488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 345/662] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:22.379031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e054a-249f-4405-b35d-2bf6a716aa6a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.422805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b55bf-e51a-485c-bade-bdc1327b8fc6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.436544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.456215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae8753-db39-4954-9604-83c8911efe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.456854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae8753-db39-4954-9604-83c8911efe54 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.457134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae8753-db39-4954-9604-83c8911efe54 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.457737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae8753-db39-4954-9604-83c8911efe54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.467841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae8753-db39-4954-9604-83c8911efe54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-deae8753-db39-4954-9604-83c8911efe54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:22.472626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:22.473565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:22.474475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:22.475609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 318/663] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:22.476176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae8753-db39-4954-9604-83c8911efe54 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.476670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e054a-249f-4405-b35d-2bf6a716aa6a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.511199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141bafb-9627-4b72-b682-b3b8a0a9fdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.511806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141bafb-9627-4b72-b682-b3b8a0a9fdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.512087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141bafb-9627-4b72-b682-b3b8a0a9fdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.512352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141bafb-9627-4b72-b682-b3b8a0a9fdd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.513084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141bafb-9627-4b72-b682-b3b8a0a9fdd7 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=6955fc5b81a040f686e21621ea968a6e) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:22.513587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141bafb-9627-4b72-b682-b3b8a0a9fdd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.515032 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141bafb-9627-4b72-b682-b3b8a0a9fdd7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.520943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 346/664] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/role_assignments?user.id=6955fc5b81a040f686e21621ea968a6e&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:22.521652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141bafb-9627-4b72-b682-b3b8a0a9fdd7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.546230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.593719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae8753-db39-4954-9604-83c8911efe54 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.635820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa026d8-91a2-4e1c-960a-a727c3ac99c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.636430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa026d8-91a2-4e1c-960a-a727c3ac99c9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.636708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa026d8-91a2-4e1c-960a-a727c3ac99c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.636987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa026d8-91a2-4e1c-960a-a727c3ac99c9 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.637718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa026d8-91a2-4e1c-960a-a727c3ac99c9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:22.638023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa026d8-91a2-4e1c-960a-a727c3ac99c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.639543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa026d8-91a2-4e1c-960a-a727c3ac99c9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.641035 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141bafb-9627-4b72-b682-b3b8a0a9fdd7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.664876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 319/665] 10.222.0.88 () {56 vars in 1139 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:22.665954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa026d8-91a2-4e1c-960a-a727c3ac99c9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.684993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06793-1350-4051-8d59-4b39cf247a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.685631 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06793-1350-4051-8d59-4b39cf247a9a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.685912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06793-1350-4051-8d59-4b39cf247a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.686190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06793-1350-4051-8d59-4b39cf247a9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.693214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f06793-1350-4051-8d59-4b39cf247a9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.694761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f06793-1350-4051-8d59-4b39cf247a9a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.701697 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d5f06793-1350-4051-8d59-4b39cf247a9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:22.708223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:22.709119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:22.710013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:22.710013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:22.710013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:22.710013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:22.710013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:22.710013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:22.710013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:22.710013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:22.710013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 347/666] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:22.710504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06793-1350-4051-8d59-4b39cf247a9a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.782367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa026d8-91a2-4e1c-960a-a727c3ac99c9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.802359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.819333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f5946-0ae7-4596-a688-a2870bffcdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.819980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f5946-0ae7-4596-a688-a2870bffcdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.820275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f5946-0ae7-4596-a688-a2870bffcdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.820538 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f5946-0ae7-4596-a688-a2870bffcdd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.822964 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f06793-1350-4051-8d59-4b39cf247a9a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.838687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f5946-0ae7-4596-a688-a2870bffcdd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.840364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f5946-0ae7-4596-a688-a2870bffcdd0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-d20f5946-0ae7-4596-a688-a2870bffcdd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:22.857556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:22.858732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:22.859865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:22.859865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:22.859865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:22.861137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 320/667] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:22.866198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f5946-0ae7-4596-a688-a2870bffcdd0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.872291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2822cb0-1a12-4447-96a6-5cc97115899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.872981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2822cb0-1a12-4447-96a6-5cc97115899f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.873331 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2822cb0-1a12-4447-96a6-5cc97115899f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.873675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2822cb0-1a12-4447-96a6-5cc97115899f None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.874426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2822cb0-1a12-4447-96a6-5cc97115899f None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:22.874803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2822cb0-1a12-4447-96a6-5cc97115899f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.876610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2822cb0-1a12-4447-96a6-5cc97115899f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.890317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 348/668] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:22.890317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2822cb0-1a12-4447-96a6-5cc97115899f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.961886 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.979011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f5946-0ae7-4596-a688-a2870bffcdd0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.000901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2822cb0-1a12-4447-96a6-5cc97115899f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.015644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169dd7-2218-4dfa-9dcd-6562fb903338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.016406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169dd7-2218-4dfa-9dcd-6562fb903338 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.016793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169dd7-2218-4dfa-9dcd-6562fb903338 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.017166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169dd7-2218-4dfa-9dcd-6562fb903338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.047571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759527-c5bb-4f1d-877b-b70395cbc740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.047571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759527-c5bb-4f1d-877b-b70395cbc740 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.047571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759527-c5bb-4f1d-877b-b70395cbc740 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.047571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759527-c5bb-4f1d-877b-b70395cbc740 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.048197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a759527-c5bb-4f1d-877b-b70395cbc740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:23.048197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a759527-c5bb-4f1d-877b-b70395cbc740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.048197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a759527-c5bb-4f1d-877b-b70395cbc740 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.053279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 349/669] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:23.054810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759527-c5bb-4f1d-877b-b70395cbc740 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.061124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.091583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f169dd7-2218-4dfa-9dcd-6562fb903338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.093084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f169dd7-2218-4dfa-9dcd-6562fb903338 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.175016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759527-c5bb-4f1d-877b-b70395cbc740 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.189161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.205604 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 321/670] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:23.206465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169dd7-2218-4dfa-9dcd-6562fb903338 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.214928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea1edc-63e2-4c2c-857d-dcbfd0d4adfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.215581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1edc-63e2-4c2c-857d-dcbfd0d4adfc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.215865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1edc-63e2-4c2c-857d-dcbfd0d4adfc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.216176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1edc-63e2-4c2c-857d-dcbfd0d4adfc None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.216806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea1edc-63e2-4c2c-857d-dcbfd0d4adfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:23.217116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea1edc-63e2-4c2c-857d-dcbfd0d4adfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.218499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea1edc-63e2-4c2c-857d-dcbfd0d4adfc None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.232094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 350/671] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:23.232713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea1edc-63e2-4c2c-857d-dcbfd0d4adfc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.294803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.316494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169dd7-2218-4dfa-9dcd-6562fb903338 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.335012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea1edc-63e2-4c2c-857d-dcbfd0d4adfc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.351280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf715c-79f6-46bd-b28d-70e69319e8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.351952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf715c-79f6-46bd-b28d-70e69319e8ae None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.352237 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf715c-79f6-46bd-b28d-70e69319e8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.352491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf715c-79f6-46bd-b28d-70e69319e8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.363850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf715c-79f6-46bd-b28d-70e69319e8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.365304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf715c-79f6-46bd-b28d-70e69319e8ae None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.372895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3b0f6-ea5e-435b-a1e3-a0f80c6f5dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.373596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3b0f6-ea5e-435b-a1e3-a0f80c6f5dea None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.373885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3b0f6-ea5e-435b-a1e3-a0f80c6f5dea None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.374181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3b0f6-ea5e-435b-a1e3-a0f80c6f5dea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.374896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3b0f6-ea5e-435b-a1e3-a0f80c6f5dea None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=9624bc4b2840420eb06d721a73655da4) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:23.375235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3b0f6-ea5e-435b-a1e3-a0f80c6f5dea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.376678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3b0f6-ea5e-435b-a1e3-a0f80c6f5dea None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-99cf715c-79f6-46bd-b28d-70e69319e8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:23.380693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:23.381805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:23.382826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:23.382826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:23.382826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:23.382826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 322/672] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:23.382826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf715c-79f6-46bd-b28d-70e69319e8ae None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.391116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 351/673] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/role_assignments?user.id=9624bc4b2840420eb06d721a73655da4&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:23.392655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3b0f6-ea5e-435b-a1e3-a0f80c6f5dea None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.421189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.507481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf715c-79f6-46bd-b28d-70e69319e8ae None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.524090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3b0f6-ea5e-435b-a1e3-a0f80c6f5dea None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.547986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9623125-b8f5-44a7-acb6-cb95a0609770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.548631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9623125-b8f5-44a7-acb6-cb95a0609770 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.548915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9623125-b8f5-44a7-acb6-cb95a0609770 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.549191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9623125-b8f5-44a7-acb6-cb95a0609770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.559082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.560296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9623125-b8f5-44a7-acb6-cb95a0609770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.561884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9623125-b8f5-44a7-acb6-cb95a0609770 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.574133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638f91e-b848-430e-a749-f0a765dc3aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.574133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638f91e-b848-430e-a749-f0a765dc3aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.574133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638f91e-b848-430e-a749-f0a765dc3aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.574133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638f91e-b848-430e-a749-f0a765dc3aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.577350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638f91e-b848-430e-a749-f0a765dc3aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.579383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638f91e-b848-430e-a749-f0a765dc3aa0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c9623125-b8f5-44a7-acb6-cb95a0609770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:23.580052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:23.581216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:23.582292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:23.582292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:23.582292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:23.588858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 323/674] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:23.589974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9623125-b8f5-44a7-acb6-cb95a0609770 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-e638f91e-b848-430e-a749-f0a765dc3aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:23.594343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:23.595472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:23.596539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:23.596539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:23.596539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:23.596539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:23.596539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:23.596539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:23.596539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:23.596539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:23.596539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 352/675] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:23.597875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638f91e-b848-430e-a749-f0a765dc3aa0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.698704 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.712780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9623125-b8f5-44a7-acb6-cb95a0609770 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.721009 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638f91e-b848-430e-a749-f0a765dc3aa0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.750731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2394c4-dd93-4f8a-88ac-c6a82e27a0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.751555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2394c4-dd93-4f8a-88ac-c6a82e27a0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.751836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2394c4-dd93-4f8a-88ac-c6a82e27a0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.752106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2394c4-dd93-4f8a-88ac-c6a82e27a0c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.752756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2394c4-dd93-4f8a-88ac-c6a82e27a0c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:23.753054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2394c4-dd93-4f8a-88ac-c6a82e27a0c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.754528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2394c4-dd93-4f8a-88ac-c6a82e27a0c6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.768036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 324/676] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:23.768888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2394c4-dd93-4f8a-88ac-c6a82e27a0c6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.772086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dbe39-703c-4cab-9036-cd9db80b468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.773686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dbe39-703c-4cab-9036-cd9db80b468f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.773982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dbe39-703c-4cab-9036-cd9db80b468f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.774263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dbe39-703c-4cab-9036-cd9db80b468f None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.774983 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dbe39-703c-4cab-9036-cd9db80b468f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:23.775341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dbe39-703c-4cab-9036-cd9db80b468f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.776763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dbe39-703c-4cab-9036-cd9db80b468f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.793764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 353/677] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:23.795360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dbe39-703c-4cab-9036-cd9db80b468f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.866032 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.898362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2394c4-dd93-4f8a-88ac-c6a82e27a0c6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.935897 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312daaa-0dd3-435e-90ff-c4e4dd091bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.936506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312daaa-0dd3-435e-90ff-c4e4dd091bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.936783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312daaa-0dd3-435e-90ff-c4e4dd091bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.936949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dbe39-703c-4cab-9036-cd9db80b468f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.937101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312daaa-0dd3-435e-90ff-c4e4dd091bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.937736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312daaa-0dd3-435e-90ff-c4e4dd091bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:23.938117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312daaa-0dd3-435e-90ff-c4e4dd091bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.939637 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312daaa-0dd3-435e-90ff-c4e4dd091bc8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.953501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 325/678] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:23.954981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312daaa-0dd3-435e-90ff-c4e4dd091bc8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.967336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.983731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bf5c8-c8d9-4f09-bbd8-48fd703186ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.984656 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf5c8-c8d9-4f09-bbd8-48fd703186ed None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.984942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf5c8-c8d9-4f09-bbd8-48fd703186ed None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.985224 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf5c8-c8d9-4f09-bbd8-48fd703186ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.995342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bf5c8-c8d9-4f09-bbd8-48fd703186ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.996795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bf5c8-c8d9-4f09-bbd8-48fd703186ed None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0e9bf5c8-c8d9-4f09-bbd8-48fd703186ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:24.014073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:24.015096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:24.016078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:24.016078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:24.016078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:24.016078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:24.016078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:24.016078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:24.016078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:24.016078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:24.016078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:24.016078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:24.018770 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 354/679] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:24.019845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bf5c8-c8d9-4f09-bbd8-48fd703186ed None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.077477 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312daaa-0dd3-435e-90ff-c4e4dd091bc8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.125646 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf77ab-a34f-4229-975e-449a5d1cf6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.126484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf77ab-a34f-4229-975e-449a5d1cf6cf None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.126776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf77ab-a34f-4229-975e-449a5d1cf6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.127075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf77ab-a34f-4229-975e-449a5d1cf6cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.135570 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf77ab-a34f-4229-975e-449a5d1cf6cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.137576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf77ab-a34f-4229-975e-449a5d1cf6cf None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.149290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bf5c8-c8d9-4f09-bbd8-48fd703186ed None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-44bf77ab-a34f-4229-975e-449a5d1cf6cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:24.153355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:24.154248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:24.155187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:24.155187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:24.155187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:24.155187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:24.155187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:24.155187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:24.155187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:24.155187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:24.155187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 326/680] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:24.155770 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf77ab-a34f-4229-975e-449a5d1cf6cf None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.157894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.188836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baeff94-ee06-41ab-9d55-95c3155d5d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.189460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baeff94-ee06-41ab-9d55-95c3155d5d98 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.189748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baeff94-ee06-41ab-9d55-95c3155d5d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.190025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baeff94-ee06-41ab-9d55-95c3155d5d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.190766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baeff94-ee06-41ab-9d55-95c3155d5d98 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=380240bcfca240a2b4969f6618409a2f) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:24.191102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baeff94-ee06-41ab-9d55-95c3155d5d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.192745 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baeff94-ee06-41ab-9d55-95c3155d5d98 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.198985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 355/681] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/role_assignments?user.id=380240bcfca240a2b4969f6618409a2f&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:24.199940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baeff94-ee06-41ab-9d55-95c3155d5d98 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.243967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.286794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf77ab-a34f-4229-975e-449a5d1cf6cf None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.327493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f935c3d-c1a6-4970-9a13-f84d06d0a7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.328118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f935c3d-c1a6-4970-9a13-f84d06d0a7fa None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.328406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f935c3d-c1a6-4970-9a13-f84d06d0a7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.328672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f935c3d-c1a6-4970-9a13-f84d06d0a7fa None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.329444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f935c3d-c1a6-4970-9a13-f84d06d0a7fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:24.329752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f935c3d-c1a6-4970-9a13-f84d06d0a7fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.331279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f935c3d-c1a6-4970-9a13-f84d06d0a7fa None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.359324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 327/682] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:24.360734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f935c3d-c1a6-4970-9a13-f84d06d0a7fa None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.432200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baeff94-ee06-41ab-9d55-95c3155d5d98 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.473246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a07cbc-efc7-434c-883d-78a39256c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.473867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a07cbc-efc7-434c-883d-78a39256c229 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.474154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a07cbc-efc7-434c-883d-78a39256c229 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.475396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a07cbc-efc7-434c-883d-78a39256c229 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.476174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a07cbc-efc7-434c-883d-78a39256c229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:24.476492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a07cbc-efc7-434c-883d-78a39256c229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.478669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a07cbc-efc7-434c-883d-78a39256c229 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.487634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f935c3d-c1a6-4970-9a13-f84d06d0a7fa None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.501326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 356/683] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:24.508410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a07cbc-efc7-434c-883d-78a39256c229 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.531078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.542745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961b57c-4624-4ac2-b08d-5130d98deee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.543882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961b57c-4624-4ac2-b08d-5130d98deee2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.544068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961b57c-4624-4ac2-b08d-5130d98deee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.544285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961b57c-4624-4ac2-b08d-5130d98deee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.563412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.637604 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961b57c-4624-4ac2-b08d-5130d98deee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.639103 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961b57c-4624-4ac2-b08d-5130d98deee2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.646557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a07cbc-efc7-434c-883d-78a39256c229 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.701092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916acdb0-4f9b-4cca-881e-136e17247ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.701655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916acdb0-4f9b-4cca-881e-136e17247ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.701942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916acdb0-4f9b-4cca-881e-136e17247ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.702239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916acdb0-4f9b-4cca-881e-136e17247ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.703264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916acdb0-4f9b-4cca-881e-136e17247ab6 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=b4ab7a3b191e4a0b84b396cafa8a9ff7) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:24.703605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916acdb0-4f9b-4cca-881e-136e17247ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.705491 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916acdb0-4f9b-4cca-881e-136e17247ab6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.713881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 357/684] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/role_assignments?user.id=b4ab7a3b191e4a0b84b396cafa8a9ff7&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:24.715573 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45784654-50d4-4338-903e-f9cddb8e017f None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.716059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45784654-50d4-4338-903e-f9cddb8e017f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.716528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45784654-50d4-4338-903e-f9cddb8e017f None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.723916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 358/685] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:24.728172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf79b5-0fb2-4efc-a2e9-9940c38fd192 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.730184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf79b5-0fb2-4efc-a2e9-9940c38fd192 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.731829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf79b5-0fb2-4efc-a2e9-9940c38fd192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.770194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7adf79b5-0fb2-4efc-a2e9-9940c38fd192 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:24.773795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7adf79b5-0fb2-4efc-a2e9-9940c38fd192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:24.816702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 328/686] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:24.822904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961b57c-4624-4ac2-b08d-5130d98deee2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.894790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.924718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 359/687] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:24.980223 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961b57c-4624-4ac2-b08d-5130d98deee2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.018857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258b061-9871-4537-aacd-687cf1554f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.019908 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258b061-9871-4537-aacd-687cf1554f76 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.020388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258b061-9871-4537-aacd-687cf1554f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.020899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258b061-9871-4537-aacd-687cf1554f76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.032292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258b061-9871-4537-aacd-687cf1554f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.034109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258b061-9871-4537-aacd-687cf1554f76 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-b258b061-9871-4537-aacd-687cf1554f76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:25.050143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:25.051200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:25.052118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:25.052118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:25.052118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:25.058599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 329/688] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:25.060201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf79b5-0fb2-4efc-a2e9-9940c38fd192 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.088335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.184000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf79b5-0fb2-4efc-a2e9-9940c38fd192 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.221477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37df603-024d-4688-87ca-d06844c94cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.222104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37df603-024d-4688-87ca-d06844c94cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.222388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37df603-024d-4688-87ca-d06844c94cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.222668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37df603-024d-4688-87ca-d06844c94cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.223360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37df603-024d-4688-87ca-d06844c94cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:25.223671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37df603-024d-4688-87ca-d06844c94cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.225066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37df603-024d-4688-87ca-d06844c94cb8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.236787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258b061-9871-4537-aacd-687cf1554f76 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.244867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 360/689] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:25.251763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37df603-024d-4688-87ca-d06844c94cb8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.354601 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.362293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.377064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258b061-9871-4537-aacd-687cf1554f76 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.383358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37df603-024d-4688-87ca-d06844c94cb8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.414805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697ff85-b6bd-4aee-b427-97b54da58d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.415605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697ff85-b6bd-4aee-b427-97b54da58d6b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.416003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697ff85-b6bd-4aee-b427-97b54da58d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.416342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697ff85-b6bd-4aee-b427-97b54da58d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.432480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697ff85-b6bd-4aee-b427-97b54da58d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.434452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aeb93-8db1-4c6d-83dd-6cd0be267fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.434452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aeb93-8db1-4c6d-83dd-6cd0be267fca None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.434986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697ff85-b6bd-4aee-b427-97b54da58d6b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.436579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aeb93-8db1-4c6d-83dd-6cd0be267fca None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.436579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aeb93-8db1-4c6d-83dd-6cd0be267fca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.448529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987aeb93-8db1-4c6d-83dd-6cd0be267fca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.451752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987aeb93-8db1-4c6d-83dd-6cd0be267fca None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-7697ff85-b6bd-4aee-b427-97b54da58d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:25.458640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:25.459645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:25.460569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:25.460569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:25.460569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:25.463425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 330/690] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-987aeb93-8db1-4c6d-83dd-6cd0be267fca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:25.472959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:25.473870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:25.474773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:25.474773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:25.474773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:25.474773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:25.474773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:25.474773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:25.474773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:25.474773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:25.476729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697ff85-b6bd-4aee-b427-97b54da58d6b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.482274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 361/691] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:25.487174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aeb93-8db1-4c6d-83dd-6cd0be267fca None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.658617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aeb93-8db1-4c6d-83dd-6cd0be267fca None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.672649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697ff85-b6bd-4aee-b427-97b54da58d6b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.697162 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eac4e2-8b2b-481e-83c9-f3bc9aaaad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.698128 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eac4e2-8b2b-481e-83c9-f3bc9aaaad0f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.698634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eac4e2-8b2b-481e-83c9-f3bc9aaaad0f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.699147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eac4e2-8b2b-481e-83c9-f3bc9aaaad0f None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.700069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eac4e2-8b2b-481e-83c9-f3bc9aaaad0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:25.700603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eac4e2-8b2b-481e-83c9-f3bc9aaaad0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.702250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eac4e2-8b2b-481e-83c9-f3bc9aaaad0f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.707194 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.715770 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2eae9-14fb-4463-a5d9-2109ae2aa822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.725586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2eae9-14fb-4463-a5d9-2109ae2aa822 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.725586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2eae9-14fb-4463-a5d9-2109ae2aa822 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.725586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2eae9-14fb-4463-a5d9-2109ae2aa822 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.725586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2eae9-14fb-4463-a5d9-2109ae2aa822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:25.725888 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 362/692] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:25.725986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2eae9-14fb-4463-a5d9-2109ae2aa822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.726060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742bf0-3604-487b-bafe-b521d38bd8dd None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.726129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2eae9-14fb-4463-a5d9-2109ae2aa822 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.726197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742bf0-3604-487b-bafe-b521d38bd8dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.726197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742bf0-3604-487b-bafe-b521d38bd8dd None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.726197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 363/693] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:25.727348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0742bf0-3604-487b-bafe-b521d38bd8dd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.732161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.851731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0742bf0-3604-487b-bafe-b521d38bd8dd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.874196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 331/694] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:25.875558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e4eb-34dd-4328-9bb1-1299cbdc54aa None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.875844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e4eb-34dd-4328-9bb1-1299cbdc54aa None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.876175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e4eb-34dd-4328-9bb1-1299cbdc54aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.894428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36701368-b0cb-470c-a67c-fcd1cf0bfcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.895030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701368-b0cb-470c-a67c-fcd1cf0bfcd2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.895424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701368-b0cb-470c-a67c-fcd1cf0bfcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.895743 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701368-b0cb-470c-a67c-fcd1cf0bfcd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.896486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36701368-b0cb-470c-a67c-fcd1cf0bfcd2 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=d4052d31496a46948211cd4b7d38808b) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:25.896796 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36701368-b0cb-470c-a67c-fcd1cf0bfcd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.897874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d8f4e4eb-34dd-4328-9bb1-1299cbdc54aa None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:25.898225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36701368-b0cb-470c-a67c-fcd1cf0bfcd2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.900122 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d8f4e4eb-34dd-4328-9bb1-1299cbdc54aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:25.906318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 364/695] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/role_assignments?user.id=d4052d31496a46948211cd4b7d38808b&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:25.907180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36701368-b0cb-470c-a67c-fcd1cf0bfcd2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.038084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 332/696] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:26.052587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.100744 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36701368-b0cb-470c-a67c-fcd1cf0bfcd2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.139072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4e5da-651e-47f7-bba8-7cf77d1b2ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.139636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4e5da-651e-47f7-bba8-7cf77d1b2ab9 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.139916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4e5da-651e-47f7-bba8-7cf77d1b2ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.140190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4e5da-651e-47f7-bba8-7cf77d1b2ab9 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.140840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4e5da-651e-47f7-bba8-7cf77d1b2ab9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.142284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4e5da-651e-47f7-bba8-7cf77d1b2ab9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.229541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 365/697] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:27:25 2022] POST /identity/v3/users => generated 254 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:26.354405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4e4eb-34dd-4328-9bb1-1299cbdc54aa None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.475536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4e4eb-34dd-4328-9bb1-1299cbdc54aa None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.496814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.512015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633116a6-a68a-4e20-91fb-e5bcbfb84c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.512656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633116a6-a68a-4e20-91fb-e5bcbfb84c8e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.512935 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633116a6-a68a-4e20-91fb-e5bcbfb84c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.513208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633116a6-a68a-4e20-91fb-e5bcbfb84c8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.523894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633116a6-a68a-4e20-91fb-e5bcbfb84c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-633116a6-a68a-4e20-91fb-e5bcbfb84c8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:26.529010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:26.530015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:26.530880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 333/698] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:26.536021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4e5da-651e-47f7-bba8-7cf77d1b2ab9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.615378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ecdc-de7f-4605-88af-538b5f488315 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.615715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ecdc-de7f-4605-88af-538b5f488315 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.615931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1ecdc-de7f-4605-88af-538b5f488315 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.617534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 334/699] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:26.623447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b68dc-2619-4ac5-836a-429fd55e5a21 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.623727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b68dc-2619-4ac5-836a-429fd55e5a21 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.623996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b68dc-2619-4ac5-836a-429fd55e5a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.657833 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0d7b68dc-2619-4ac5-836a-429fd55e5a21 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:26.659966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0d7b68dc-2619-4ac5-836a-429fd55e5a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:26.665656 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4e5da-651e-47f7-bba8-7cf77d1b2ab9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.692637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.704688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee59cd-9c2c-4b28-af9d-7018acbb9f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.705595 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee59cd-9c2c-4b28-af9d-7018acbb9f39 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.705830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee59cd-9c2c-4b28-af9d-7018acbb9f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.706127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee59cd-9c2c-4b28-af9d-7018acbb9f39 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.707012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee59cd-9c2c-4b28-af9d-7018acbb9f39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:26.707355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee59cd-9c2c-4b28-af9d-7018acbb9f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.708754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee59cd-9c2c-4b28-af9d-7018acbb9f39 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.718727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 366/700] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:26.724888 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee59cd-9c2c-4b28-af9d-7018acbb9f39 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.769674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 335/701] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:27:26.875169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee59cd-9c2c-4b28-af9d-7018acbb9f39 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.934677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bcc9d-8ee6-4541-8b8c-28dddf93a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.935356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bcc9d-8ee6-4541-8b8c-28dddf93a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.935642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bcc9d-8ee6-4541-8b8c-28dddf93a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.935917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bcc9d-8ee6-4541-8b8c-28dddf93a2e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.946949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064bcc9d-8ee6-4541-8b8c-28dddf93a2e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.948625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064bcc9d-8ee6-4541-8b8c-28dddf93a2e8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-064bcc9d-8ee6-4541-8b8c-28dddf93a2e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:26.971176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:26.972177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:26.973096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:26.973096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:26.973096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:26.973096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 367/702] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:26.981138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b68dc-2619-4ac5-836a-429fd55e5a21 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.117039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b68dc-2619-4ac5-836a-429fd55e5a21 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.132769 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.168873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e854f8-b2e3-4510-9301-9c1b3d14a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.169499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e854f8-b2e3-4510-9301-9c1b3d14a722 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.169779 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e854f8-b2e3-4510-9301-9c1b3d14a722 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.170055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e854f8-b2e3-4510-9301-9c1b3d14a722 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.170717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e854f8-b2e3-4510-9301-9c1b3d14a722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:27.171018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e854f8-b2e3-4510-9301-9c1b3d14a722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.172595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e854f8-b2e3-4510-9301-9c1b3d14a722 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.190514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 336/703] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:27.192605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bcc9d-8ee6-4541-8b8c-28dddf93a2e8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.203039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e854f8-b2e3-4510-9301-9c1b3d14a722 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.266790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.347904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bcc9d-8ee6-4541-8b8c-28dddf93a2e8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.373365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e854f8-b2e3-4510-9301-9c1b3d14a722 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.386529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd6c4-b734-46be-8e35-f958012f6b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.387114 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd6c4-b734-46be-8e35-f958012f6b1f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.387400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd6c4-b734-46be-8e35-f958012f6b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.387674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd6c4-b734-46be-8e35-f958012f6b1f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.388263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bd6c4-b734-46be-8e35-f958012f6b1f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.389751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bd6c4-b734-46be-8e35-f958012f6b1f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-603bd6c4-b734-46be-8e35-f958012f6b1f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:27.401054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:27.402116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:27.403100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 368/704] 10.222.0.88 () {56 vars in 1129 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:27.403925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013275b9-7271-4af4-8410-ee82a7cf05c4 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.404569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013275b9-7271-4af4-8410-ee82a7cf05c4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.404569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013275b9-7271-4af4-8410-ee82a7cf05c4 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.411100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 369/705] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:27.412134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bb2ec-9d96-4081-90a2-657152e637a6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.412421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bb2ec-9d96-4081-90a2-657152e637a6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.412697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bb2ec-9d96-4081-90a2-657152e637a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.423683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f68445-3f85-4f29-862a-3480108136c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.424756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f68445-3f85-4f29-862a-3480108136c5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.425268 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f68445-3f85-4f29-862a-3480108136c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.425746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f68445-3f85-4f29-862a-3480108136c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.434092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a24bb2ec-9d96-4081-90a2-657152e637a6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:27.434437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f68445-3f85-4f29-862a-3480108136c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.435363 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a24bb2ec-9d96-4081-90a2-657152e637a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:27.436374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f68445-3f85-4f29-862a-3480108136c5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-27f68445-3f85-4f29-862a-3480108136c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:27.449632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:27.450592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:27.451596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:27.451596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:27.451596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:27.451596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:27.451596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:27.451596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:27.451596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:27.451596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:27.451596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:27.451596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:27.458610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 337/706] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:27.459853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f68445-3f85-4f29-862a-3480108136c5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.493887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.513640 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 370/707] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:27:27.513640 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bb2ec-9d96-4081-90a2-657152e637a6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.543566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.614903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f68445-3f85-4f29-862a-3480108136c5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.618312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bb2ec-9d96-4081-90a2-657152e637a6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.654650 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cccb8-0ad0-4a76-a9a7-8506b21418a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.655007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cccb8-0ad0-4a76-a9a7-8506b21418a1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.655338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cccb8-0ad0-4a76-a9a7-8506b21418a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.655614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cccb8-0ad0-4a76-a9a7-8506b21418a1 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.656364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cccb8-0ad0-4a76-a9a7-8506b21418a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:27.656653 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cccb8-0ad0-4a76-a9a7-8506b21418a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.658219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cccb8-0ad0-4a76-a9a7-8506b21418a1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.676782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d142e-b9be-40f9-9af6-a54449ce3a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.677548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 371/708] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:27.677926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d142e-b9be-40f9-9af6-a54449ce3a55 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.678208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d142e-b9be-40f9-9af6-a54449ce3a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.678483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d142e-b9be-40f9-9af6-a54449ce3a55 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.679160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d142e-b9be-40f9-9af6-a54449ce3a55 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:27.679541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d142e-b9be-40f9-9af6-a54449ce3a55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.681385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d142e-b9be-40f9-9af6-a54449ce3a55 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.691209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cccb8-0ad0-4a76-a9a7-8506b21418a1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.693434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 338/709] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:27.699106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d142e-b9be-40f9-9af6-a54449ce3a55 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.818776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.826933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d142e-b9be-40f9-9af6-a54449ce3a55 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.865800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd6f4-2d06-433d-ae27-3f4d1361b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.866870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd6f4-2d06-433d-ae27-3f4d1361b076 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.867379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd6f4-2d06-433d-ae27-3f4d1361b076 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.867869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bd6f4-2d06-433d-ae27-3f4d1361b076 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.869325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bd6f4-2d06-433d-ae27-3f4d1361b076 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:27.869845 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bd6f4-2d06-433d-ae27-3f4d1361b076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.871450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bd6f4-2d06-433d-ae27-3f4d1361b076 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.878236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 339/710] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:27.898934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.918998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cccb8-0ad0-4a76-a9a7-8506b21418a1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.932241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd6f4-2d06-433d-ae27-3f4d1361b076 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.976963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38f338-ed74-4b63-b41b-d80bcf321ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.977619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38f338-ed74-4b63-b41b-d80bcf321ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.977963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38f338-ed74-4b63-b41b-d80bcf321ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.978245 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38f338-ed74-4b63-b41b-d80bcf321ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.050476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bd6f4-2d06-433d-ae27-3f4d1361b076 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.091282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38f338-ed74-4b63-b41b-d80bcf321ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.091282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38f338-ed74-4b63-b41b-d80bcf321ed6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.110810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9397fff-2b99-4890-b54c-138353afd8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.111509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9397fff-2b99-4890-b54c-138353afd8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.111786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9397fff-2b99-4890-b54c-138353afd8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.112059 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9397fff-2b99-4890-b54c-138353afd8c9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.112724 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9397fff-2b99-4890-b54c-138353afd8c9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.114130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9397fff-2b99-4890-b54c-138353afd8c9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f9397fff-2b99-4890-b54c-138353afd8c9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:28.138507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:28.140061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:28.140979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:28.142316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 340/711] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:28.145555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9397fff-2b99-4890-b54c-138353afd8c9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.182062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.294415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.298371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9397fff-2b99-4890-b54c-138353afd8c9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.315867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 372/712] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:28.323397 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38f338-ed74-4b63-b41b-d80bcf321ed6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.374580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba022c-9b52-4f8c-b679-5716955b0f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.375623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba022c-9b52-4f8c-b679-5716955b0f21 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.376109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba022c-9b52-4f8c-b679-5716955b0f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.376581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba022c-9b52-4f8c-b679-5716955b0f21 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.377444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba022c-9b52-4f8c-b679-5716955b0f21 None admin] RBAC: Adding query filter params (name=network) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:28.377996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba022c-9b52-4f8c-b679-5716955b0f21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.379623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba022c-9b52-4f8c-b679-5716955b0f21 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.386904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 341/713] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:28.388481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85354b4d-8fda-4968-af59-f9e478b772e9 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.388997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85354b4d-8fda-4968-af59-f9e478b772e9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.389467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85354b4d-8fda-4968-af59-f9e478b772e9 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.395262 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 342/714] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:28.396305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85354b4d-8fda-4968-af59-f9e478b772e9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.431873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38f338-ed74-4b63-b41b-d80bcf321ed6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.468767 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0bc87-335c-4d92-af7b-8b52d7948e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.469350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bc87-335c-4d92-af7b-8b52d7948e76 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.469634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bc87-335c-4d92-af7b-8b52d7948e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.469910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bc87-335c-4d92-af7b-8b52d7948e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.481184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0bc87-335c-4d92-af7b-8b52d7948e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.482672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0bc87-335c-4d92-af7b-8b52d7948e76 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.491858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-52b0bc87-335c-4d92-af7b-8b52d7948e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:28.498335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:28.499424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:28.500354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:28.500354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:28.500354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:28.504096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 373/715] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:28.505475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edeae3-eb91-4bba-a8fb-a3711aa75962 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.512949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edeae3-eb91-4bba-a8fb-a3711aa75962 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.512949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edeae3-eb91-4bba-a8fb-a3711aa75962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.513297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85354b4d-8fda-4968-af59-f9e478b772e9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.525982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-69edeae3-eb91-4bba-a8fb-a3711aa75962 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:28.527954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-69edeae3-eb91-4bba-a8fb-a3711aa75962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:28.553370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49836d84-6684-4e3f-9e1d-530762cb22ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.554354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49836d84-6684-4e3f-9e1d-530762cb22ff None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.554882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49836d84-6684-4e3f-9e1d-530762cb22ff None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.555391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49836d84-6684-4e3f-9e1d-530762cb22ff None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.556312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49836d84-6684-4e3f-9e1d-530762cb22ff None admin] RBAC: Adding query filter params (type=network) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:28.556839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49836d84-6684-4e3f-9e1d-530762cb22ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.558562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49836d84-6684-4e3f-9e1d-530762cb22ff None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.564236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 343/716] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:28.565373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49836d84-6684-4e3f-9e1d-530762cb22ff None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.575308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.620840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 374/717] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:28.706910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49836d84-6684-4e3f-9e1d-530762cb22ff None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.747337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4b1b5-cbbe-43f3-b4c7-3dbf3d2ac517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.748189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b1b5-cbbe-43f3-b4c7-3dbf3d2ac517 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.748616 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b1b5-cbbe-43f3-b4c7-3dbf3d2ac517 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.749104 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b1b5-cbbe-43f3-b4c7-3dbf3d2ac517 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.749915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4b1b5-cbbe-43f3-b4c7-3dbf3d2ac517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:28.750366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4b1b5-cbbe-43f3-b4c7-3dbf3d2ac517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.751988 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4b1b5-cbbe-43f3-b4c7-3dbf3d2ac517 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.773039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 344/718] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:28.779052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edeae3-eb91-4bba-a8fb-a3711aa75962 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.809700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c83a-043b-438e-bcfc-eb6d32f20274 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.809990 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c83a-043b-438e-bcfc-eb6d32f20274 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.810269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c83a-043b-438e-bcfc-eb6d32f20274 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.811902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 345/719] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:28.817023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa7ef0-d3cf-46fd-a7d8-741535bdff5f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.817311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa7ef0-d3cf-46fd-a7d8-741535bdff5f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.817594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa7ef0-d3cf-46fd-a7d8-741535bdff5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.840187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-44aa7ef0-d3cf-46fd-a7d8-741535bdff5f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:28.841705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-44aa7ef0-d3cf-46fd-a7d8-741535bdff5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:28.851226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.917226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edeae3-eb91-4bba-a8fb-a3711aa75962 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.943221 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 346/720] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:27:29.008413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5885fe-c8ce-4a0c-95a6-4e6a158a8df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.009510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5885fe-c8ce-4a0c-95a6-4e6a158a8df6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.009787 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5885fe-c8ce-4a0c-95a6-4e6a158a8df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.010061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5885fe-c8ce-4a0c-95a6-4e6a158a8df6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.028268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5885fe-c8ce-4a0c-95a6-4e6a158a8df6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.029751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5885fe-c8ce-4a0c-95a6-4e6a158a8df6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.034371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa7ef0-d3cf-46fd-a7d8-741535bdff5f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-fb5885fe-c8ce-4a0c-95a6-4e6a158a8df6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:29.049922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:29.050870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:29.051803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:29.051803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:29.051803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:29.051803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:29.051803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:29.051803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:29.051803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:29.051803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:29.051803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 375/721] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:29.055196 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5885fe-c8ce-4a0c-95a6-4e6a158a8df6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.122264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.222289 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa7ef0-d3cf-46fd-a7d8-741535bdff5f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.246570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5885fe-c8ce-4a0c-95a6-4e6a158a8df6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.281323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ca4a0-d2f0-4c24-9c4d-ad7109672571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.282367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ca4a0-d2f0-4c24-9c4d-ad7109672571 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.283078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ca4a0-d2f0-4c24-9c4d-ad7109672571 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.283531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ca4a0-d2f0-4c24-9c4d-ad7109672571 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.287840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99941e1-8bee-4637-8c29-9febde00ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.288462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99941e1-8bee-4637-8c29-9febde00ea43 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.288746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99941e1-8bee-4637-8c29-9febde00ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.289023 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99941e1-8bee-4637-8c29-9febde00ea43 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.289729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99941e1-8bee-4637-8c29-9febde00ea43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:29.290130 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99941e1-8bee-4637-8c29-9febde00ea43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.291581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99941e1-8bee-4637-8c29-9febde00ea43 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.293350 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.297564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ca4a0-d2f0-4c24-9c4d-ad7109672571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-ac6ca4a0-d2f0-4c24-9c4d-ad7109672571 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:29.304178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:29.308020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:29.308874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:29.309529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 376/722] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:29.309529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99941e1-8bee-4637-8c29-9febde00ea43 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.309667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 347/723] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:29.312392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ca4a0-d2f0-4c24-9c4d-ad7109672571 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.424504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ca4a0-d2f0-4c24-9c4d-ad7109672571 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.429715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.442033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99941e1-8bee-4637-8c29-9febde00ea43 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.460870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ea10d-cea0-4ccd-b353-1736721b308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.461467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ea10d-cea0-4ccd-b353-1736721b308a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.462308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ea10d-cea0-4ccd-b353-1736721b308a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.462589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ea10d-cea0-4ccd-b353-1736721b308a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.463359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ea10d-cea0-4ccd-b353-1736721b308a None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=9624bc4b2840420eb06d721a73655da4) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:29.463757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ea10d-cea0-4ccd-b353-1736721b308a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.465128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ea10d-cea0-4ccd-b353-1736721b308a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.479088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 348/724] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/role_assignments?user.id=9624bc4b2840420eb06d721a73655da4&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:29.479088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ea10d-cea0-4ccd-b353-1736721b308a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.502990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7931006-155a-45ad-8e42-5ec583253b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.503678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931006-155a-45ad-8e42-5ec583253b7b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.503962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931006-155a-45ad-8e42-5ec583253b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.504238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931006-155a-45ad-8e42-5ec583253b7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.530015 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7931006-155a-45ad-8e42-5ec583253b7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b7931006-155a-45ad-8e42-5ec583253b7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:29.538388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:29.539409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:29.540923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:29.547058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 377/725] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:29.549711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7931006-155a-45ad-8e42-5ec583253b7b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.612007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.678900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ea10d-cea0-4ccd-b353-1736721b308a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.728534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32db2b-2413-4cda-82da-3c67f3ed838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.729792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32db2b-2413-4cda-82da-3c67f3ed838f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.730528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32db2b-2413-4cda-82da-3c67f3ed838f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.731264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32db2b-2413-4cda-82da-3c67f3ed838f None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.732301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32db2b-2413-4cda-82da-3c67f3ed838f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:29.732785 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32db2b-2413-4cda-82da-3c67f3ed838f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.734867 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32db2b-2413-4cda-82da-3c67f3ed838f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.735961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7931006-155a-45ad-8e42-5ec583253b7b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.746842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 349/726] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:29.752235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32db2b-2413-4cda-82da-3c67f3ed838f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.778927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351215e-5270-4534-97b5-23b0097883db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.779651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351215e-5270-4534-97b5-23b0097883db None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.779939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351215e-5270-4534-97b5-23b0097883db None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.780283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351215e-5270-4534-97b5-23b0097883db None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.780972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351215e-5270-4534-97b5-23b0097883db None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:29.781282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351215e-5270-4534-97b5-23b0097883db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.783300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351215e-5270-4534-97b5-23b0097883db None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.796295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 378/727] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:29.802205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351215e-5270-4534-97b5-23b0097883db None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.831790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.931097 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32db2b-2413-4cda-82da-3c67f3ed838f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.955884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.966017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da2ba3-0b8f-4599-a99d-7839df16bbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.966855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da2ba3-0b8f-4599-a99d-7839df16bbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.967346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da2ba3-0b8f-4599-a99d-7839df16bbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.967772 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da2ba3-0b8f-4599-a99d-7839df16bbd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.979125 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da2ba3-0b8f-4599-a99d-7839df16bbd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.981158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da2ba3-0b8f-4599-a99d-7839df16bbd9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-40da2ba3-0b8f-4599-a99d-7839df16bbd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:29.998178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:29.999435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:30.000549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:30.000549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:30.000549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:30.001580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351215e-5270-4534-97b5-23b0097883db None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.002521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 350/728] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:30.008012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da2ba3-0b8f-4599-a99d-7839df16bbd9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.056642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1835c22-e57e-4c4a-bcde-da512ad401cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.057199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1835c22-e57e-4c4a-bcde-da512ad401cf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.057481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1835c22-e57e-4c4a-bcde-da512ad401cf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.057756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1835c22-e57e-4c4a-bcde-da512ad401cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.069332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1835c22-e57e-4c4a-bcde-da512ad401cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.070870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1835c22-e57e-4c4a-bcde-da512ad401cf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a1835c22-e57e-4c4a-bcde-da512ad401cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:30.091356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:30.092533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:30.093662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:30.093662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:30.093662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:30.093662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 379/729] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:30.093984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37100ee3-ccf0-4caa-ae00-c328f7348fb9 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.094246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37100ee3-ccf0-4caa-ae00-c328f7348fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.094517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37100ee3-ccf0-4caa-ae00-c328f7348fb9 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.099154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 380/730] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:30.100649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37100ee3-ccf0-4caa-ae00-c328f7348fb9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.144064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da2ba3-0b8f-4599-a99d-7839df16bbd9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.178566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.200358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e470e3-edf5-41fb-9321-60110e1985bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.201072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e470e3-edf5-41fb-9321-60110e1985bf None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.201354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e470e3-edf5-41fb-9321-60110e1985bf None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.201630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e470e3-edf5-41fb-9321-60110e1985bf None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.202282 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e470e3-edf5-41fb-9321-60110e1985bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:30.202586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e470e3-edf5-41fb-9321-60110e1985bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.204485 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e470e3-edf5-41fb-9321-60110e1985bf None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.223215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 351/731] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:30.223215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c47b-1198-4170-b8f1-523b6c667ea3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.223215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c47b-1198-4170-b8f1-523b6c667ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.223215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c47b-1198-4170-b8f1-523b6c667ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.227067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37100ee3-ccf0-4caa-ae00-c328f7348fb9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.240651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f883c47b-1198-4170-b8f1-523b6c667ea3 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:30.241858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f883c47b-1198-4170-b8f1-523b6c667ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:30.265575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66066c-9b82-43c6-9397-159b907574e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.266515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66066c-9b82-43c6-9397-159b907574e6 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.266997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66066c-9b82-43c6-9397-159b907574e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.267499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66066c-9b82-43c6-9397-159b907574e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.268407 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66066c-9b82-43c6-9397-159b907574e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:30.268995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66066c-9b82-43c6-9397-159b907574e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.270636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66066c-9b82-43c6-9397-159b907574e6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.275559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.284288 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 381/732] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:30.285514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66066c-9b82-43c6-9397-159b907574e6 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.331155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 352/733] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:30.331155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883c47b-1198-4170-b8f1-523b6c667ea3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.445137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66066c-9b82-43c6-9397-159b907574e6 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.460143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883c47b-1198-4170-b8f1-523b6c667ea3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.496691 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.513173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292e352-59e8-4c63-a72f-f9651cd6e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.517310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e352-59e8-4c63-a72f-f9651cd6e1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.517310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e352-59e8-4c63-a72f-f9651cd6e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.517310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e352-59e8-4c63-a72f-f9651cd6e1b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.525633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292e352-59e8-4c63-a72f-f9651cd6e1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.528121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292e352-59e8-4c63-a72f-f9651cd6e1b0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.529146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c226-4d51-4bae-9482-de63809d2d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.529799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c226-4d51-4bae-9482-de63809d2d6a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.530078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c226-4d51-4bae-9482-de63809d2d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.530349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c226-4d51-4bae-9482-de63809d2d6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.545740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8c226-4d51-4bae-9482-de63809d2d6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.547239 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8c226-4d51-4bae-9482-de63809d2d6a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-0292e352-59e8-4c63-a72f-f9651cd6e1b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:30.553993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:30.554926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:30.555968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:30.555968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:30.555968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:30.555968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:30.555968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:30.555968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:30.555968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:30.555968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:30.555968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:30.555968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:30.564149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 382/734] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:30.565528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292e352-59e8-4c63-a72f-f9651cd6e1b0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-e6a8c226-4d51-4bae-9482-de63809d2d6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:30.568971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:30.569984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:30.572337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:30.572337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:30.572337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:30.572337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:30.572337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:30.572337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:30.572337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:30.572337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:30.572337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:30.572337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:30.572337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 353/735] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:30.582765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c226-4d51-4bae-9482-de63809d2d6a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.639928 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.727333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292e352-59e8-4c63-a72f-f9651cd6e1b0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.762669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c226-4d51-4bae-9482-de63809d2d6a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.765394 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919983-e344-459d-92fa-7cf4e6b14c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.766035 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919983-e344-459d-92fa-7cf4e6b14c3e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.766341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919983-e344-459d-92fa-7cf4e6b14c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.766621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919983-e344-459d-92fa-7cf4e6b14c3e None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.767389 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1919983-e344-459d-92fa-7cf4e6b14c3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:30.767700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1919983-e344-459d-92fa-7cf4e6b14c3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.769249 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1919983-e344-459d-92fa-7cf4e6b14c3e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.795687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 383/736] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:30.796579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919983-e344-459d-92fa-7cf4e6b14c3e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.800628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0116d8d-2483-4867-a8a3-73320ca0e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.801245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116d8d-2483-4867-a8a3-73320ca0e5ed None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.801527 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116d8d-2483-4867-a8a3-73320ca0e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.801804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116d8d-2483-4867-a8a3-73320ca0e5ed None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.802551 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0116d8d-2483-4867-a8a3-73320ca0e5ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:30.802861 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0116d8d-2483-4867-a8a3-73320ca0e5ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.804343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0116d8d-2483-4867-a8a3-73320ca0e5ed None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.823078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 354/737] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:30.823937 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0116d8d-2483-4867-a8a3-73320ca0e5ed None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.854282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.917337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919983-e344-459d-92fa-7cf4e6b14c3e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.928860 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.944291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0116d8d-2483-4867-a8a3-73320ca0e5ed None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.954277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a3ff2-951a-4375-bb09-cb6936318646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.954630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3ff2-951a-4375-bb09-cb6936318646 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.954911 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3ff2-951a-4375-bb09-cb6936318646 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.955217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3ff2-951a-4375-bb09-cb6936318646 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.955864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a3ff2-951a-4375-bb09-cb6936318646 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.957239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a3ff2-951a-4375-bb09-cb6936318646 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.980448 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b052bc-9a11-4c68-b85c-f07436332ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.981353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b052bc-9a11-4c68-b85c-f07436332ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.981637 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b052bc-9a11-4c68-b85c-f07436332ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.981911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b052bc-9a11-4c68-b85c-f07436332ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.046599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 384/738] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:30 2022] POST /identity/v3/services => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:31.047612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a3ff2-951a-4375-bb09-cb6936318646 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.055092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b052bc-9a11-4c68-b85c-f07436332ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.057036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b052bc-9a11-4c68-b85c-f07436332ab5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.170081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.188633 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 355/739] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:31.190059 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4d179-8286-4941-8b0f-ca800fbe216d None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.190443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4d179-8286-4941-8b0f-ca800fbe216d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.190813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4d179-8286-4941-8b0f-ca800fbe216d None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.192400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 356/740] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:31.196518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4d179-8286-4941-8b0f-ca800fbe216d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.213208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.218912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a3ff2-951a-4375-bb09-cb6936318646 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.267586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b790ea-9752-4c53-8dbe-5eddc4c3c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.268954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b790ea-9752-4c53-8dbe-5eddc4c3c038 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.269241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b790ea-9752-4c53-8dbe-5eddc4c3c038 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.269519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b790ea-9752-4c53-8dbe-5eddc4c3c038 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.325695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4d179-8286-4941-8b0f-ca800fbe216d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.357862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b790ea-9752-4c53-8dbe-5eddc4c3c038 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.360255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b790ea-9752-4c53-8dbe-5eddc4c3c038 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.369709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b498a-4d1e-4f31-ad97-5c6c29f32989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.370345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b498a-4d1e-4f31-ad97-5c6c29f32989 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.370624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b498a-4d1e-4f31-ad97-5c6c29f32989 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.370897 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b498a-4d1e-4f31-ad97-5c6c29f32989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.385245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b498a-4d1e-4f31-ad97-5c6c29f32989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.386700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b498a-4d1e-4f31-ad97-5c6c29f32989 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-703b498a-4d1e-4f31-ad97-5c6c29f32989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:31.407141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:31.408162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:31.409055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:31.409055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:31.409055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:31.411218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 357/741] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:31.412766 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0100144-3603-4a06-bc62-e968a8752ca8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.413295 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0100144-3603-4a06-bc62-e968a8752ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.413786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0100144-3603-4a06-bc62-e968a8752ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.434445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e0100144-3603-4a06-bc62-e968a8752ca8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:31.436063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e0100144-3603-4a06-bc62-e968a8752ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:31.468274 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.477100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.486256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 385/742] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:31.487175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b790ea-9752-4c53-8dbe-5eddc4c3c038 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.511411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 358/743] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:31.512782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0100144-3603-4a06-bc62-e968a8752ca8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.599613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b790ea-9752-4c53-8dbe-5eddc4c3c038 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.619332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0100144-3603-4a06-bc62-e968a8752ca8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.659392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376708b-47e0-49e4-8d01-e153d0bd09a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.660426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376708b-47e0-49e4-8d01-e153d0bd09a4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.660932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376708b-47e0-49e4-8d01-e153d0bd09a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.661405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376708b-47e0-49e4-8d01-e153d0bd09a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.673919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376708b-47e0-49e4-8d01-e153d0bd09a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.675837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376708b-47e0-49e4-8d01-e153d0bd09a4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-6376708b-47e0-49e4-8d01-e153d0bd09a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:31.696740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:31.697740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:31.699177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:31.699177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:31.699177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:31.699177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 359/744] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:31.699591 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa9419-e6c9-418f-b12b-ec2f302b7f29 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.699970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa9419-e6c9-418f-b12b-ec2f302b7f29 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.700142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa9419-e6c9-418f-b12b-ec2f302b7f29 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.701636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 360/745] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:31.708112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa9419-e6c9-418f-b12b-ec2f302b7f29 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.735422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.761419 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405be9a-535c-458d-9753-92ec78b51f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.762269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405be9a-535c-458d-9753-92ec78b51f15 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.762704 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405be9a-535c-458d-9753-92ec78b51f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.763173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405be9a-535c-458d-9753-92ec78b51f15 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.763960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405be9a-535c-458d-9753-92ec78b51f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:31.764479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405be9a-535c-458d-9753-92ec78b51f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.766090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405be9a-535c-458d-9753-92ec78b51f15 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.785605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 386/746] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:31.787400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e7c8-ed58-4aa8-ba41-28e7d74864a0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.787833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e7c8-ed58-4aa8-ba41-28e7d74864a0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.788274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e7c8-ed58-4aa8-ba41-28e7d74864a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.808219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d935e7c8-ed58-4aa8-ba41-28e7d74864a0 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:31.809882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d935e7c8-ed58-4aa8-ba41-28e7d74864a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:31.819364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa9419-e6c9-418f-b12b-ec2f302b7f29 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.862069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeac3e4-bd5a-418d-a4e0-b1b0064ad0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.862740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeac3e4-bd5a-418d-a4e0-b1b0064ad0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.863082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeac3e4-bd5a-418d-a4e0-b1b0064ad0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.863376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeac3e4-bd5a-418d-a4e0-b1b0064ad0c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.864038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeac3e4-bd5a-418d-a4e0-b1b0064ad0c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:31.864406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeac3e4-bd5a-418d-a4e0-b1b0064ad0c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.865896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeac3e4-bd5a-418d-a4e0-b1b0064ad0c7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.875908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.886912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 361/747] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:31.890138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeac3e4-bd5a-418d-a4e0-b1b0064ad0c7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.895347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 387/748] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:31.896398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935e7c8-ed58-4aa8-ba41-28e7d74864a0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.971868 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.988635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeac3e4-bd5a-418d-a4e0-b1b0064ad0c7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.023720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935e7c8-ed58-4aa8-ba41-28e7d74864a0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.025017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e76a3-1691-447b-bc5c-9215e103f9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.025657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e76a3-1691-447b-bc5c-9215e103f9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.025941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e76a3-1691-447b-bc5c-9215e103f9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.026219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e76a3-1691-447b-bc5c-9215e103f9d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.033727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e76a3-1691-447b-bc5c-9215e103f9d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.035029 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e76a3-1691-447b-bc5c-9215e103f9d6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-174e76a3-1691-447b-bc5c-9215e103f9d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:32.047415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:32.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:32.049255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:32.049255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:32.049255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:32.049255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:32.049255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:32.049255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:32.049255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:32.049255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:32.049255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 362/749] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:32.049740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e76a3-1691-447b-bc5c-9215e103f9d6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.069442 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b850-b434-4185-aa2f-81955554694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.070659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b850-b434-4185-aa2f-81955554694f None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.071704 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b850-b434-4185-aa2f-81955554694f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.072190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b850-b434-4185-aa2f-81955554694f None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.073035 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9b850-b434-4185-aa2f-81955554694f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.075360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9b850-b434-4185-aa2f-81955554694f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.139354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 388/750] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:31 2022] POST /identity/v3/services => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:32.143209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b850-b434-4185-aa2f-81955554694f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.187817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e76a3-1691-447b-bc5c-9215e103f9d6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.209296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.245488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0e40-c18d-40f6-9cdf-f45161996ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.246388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0e40-c18d-40f6-9cdf-f45161996ace None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.246805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0e40-c18d-40f6-9cdf-f45161996ace None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.247269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0e40-c18d-40f6-9cdf-f45161996ace None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.250847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.255941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df0e40-c18d-40f6-9cdf-f45161996ace None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.259510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df0e40-c18d-40f6-9cdf-f45161996ace None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-50df0e40-c18d-40f6-9cdf-f45161996ace None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:32.271275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:32.272255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:32.273144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:32.273144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:32.273144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:32.273144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:32.273144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:32.273144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:32.273144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:32.273144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:32.280119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b850-b434-4185-aa2f-81955554694f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.281061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 363/751] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:32.282265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0e40-c18d-40f6-9cdf-f45161996ace None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.318984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bcbc2-e20f-42ec-a910-2b10e5056a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.319823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bcbc2-e20f-42ec-a910-2b10e5056a3f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.320171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bcbc2-e20f-42ec-a910-2b10e5056a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.320449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bcbc2-e20f-42ec-a910-2b10e5056a3f None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.321324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bcbc2-e20f-42ec-a910-2b10e5056a3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:32.321630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bcbc2-e20f-42ec-a910-2b10e5056a3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.323105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bcbc2-e20f-42ec-a910-2b10e5056a3f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.338898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 389/752] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:32.339760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bcbc2-e20f-42ec-a910-2b10e5056a3f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.418551 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0e40-c18d-40f6-9cdf-f45161996ace None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.456189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845777d-8866-48d9-8cca-d24aefc5892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.456960 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845777d-8866-48d9-8cca-d24aefc5892b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.457071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845777d-8866-48d9-8cca-d24aefc5892b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.457331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845777d-8866-48d9-8cca-d24aefc5892b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.468578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845777d-8866-48d9-8cca-d24aefc5892b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-d845777d-8866-48d9-8cca-d24aefc5892b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:32.474093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:32.475036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:32.475936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 364/753] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:32.476663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845777d-8866-48d9-8cca-d24aefc5892b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.492079 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bcbc2-e20f-42ec-a910-2b10e5056a3f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.508135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.541044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70948ffd-20c1-4703-ba22-961675ec2e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.541909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70948ffd-20c1-4703-ba22-961675ec2e94 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.542597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70948ffd-20c1-4703-ba22-961675ec2e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.543069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70948ffd-20c1-4703-ba22-961675ec2e94 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.544006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.545412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70948ffd-20c1-4703-ba22-961675ec2e94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:32.545894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70948ffd-20c1-4703-ba22-961675ec2e94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.548286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70948ffd-20c1-4703-ba22-961675ec2e94 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.569475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 390/754] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:32.569475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70948ffd-20c1-4703-ba22-961675ec2e94 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.598329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845777d-8866-48d9-8cca-d24aefc5892b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.641347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea405-36b1-4aeb-bb52-27a407ee0be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.642333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea405-36b1-4aeb-bb52-27a407ee0be8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.642817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea405-36b1-4aeb-bb52-27a407ee0be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.643335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea405-36b1-4aeb-bb52-27a407ee0be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.644835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ea405-36b1-4aeb-bb52-27a407ee0be8 None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=d4052d31496a46948211cd4b7d38808b) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:32.645156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ea405-36b1-4aeb-bb52-27a407ee0be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.646954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ea405-36b1-4aeb-bb52-27a407ee0be8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.655574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 365/755] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/role_assignments?user.id=d4052d31496a46948211cd4b7d38808b&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:32.656777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea405-36b1-4aeb-bb52-27a407ee0be8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.699467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70948ffd-20c1-4703-ba22-961675ec2e94 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.743569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92ddd8-af9c-4495-aab0-a215dfc459ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.744396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ddd8-af9c-4495-aab0-a215dfc459ee None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.744678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ddd8-af9c-4495-aab0-a215dfc459ee None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.744952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ddd8-af9c-4495-aab0-a215dfc459ee None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.745948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ddd8-af9c-4495-aab0-a215dfc459ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:32.746258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ddd8-af9c-4495-aab0-a215dfc459ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.748208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ddd8-af9c-4495-aab0-a215dfc459ee None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.763938 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 391/756] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:32.765359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92ddd8-af9c-4495-aab0-a215dfc459ee None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.806662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.865229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea405-36b1-4aeb-bb52-27a407ee0be8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.908652 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.932569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b9546-90ee-4e0d-835c-9aff51ca23a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.933196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b9546-90ee-4e0d-835c-9aff51ca23a2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.933479 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b9546-90ee-4e0d-835c-9aff51ca23a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.933756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b9546-90ee-4e0d-835c-9aff51ca23a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.933860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92ddd8-af9c-4495-aab0-a215dfc459ee None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.934498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b9546-90ee-4e0d-835c-9aff51ca23a2 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=d33c67fc513e49df9f6792475ff2d20e) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:32.934809 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b9546-90ee-4e0d-835c-9aff51ca23a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.938172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b9546-90ee-4e0d-835c-9aff51ca23a2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.959468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 366/757] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/role_assignments?user.id=d33c67fc513e49df9f6792475ff2d20e&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:32.979216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff06f-f9ea-4b30-86f8-99c2df674f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.983087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff06f-f9ea-4b30-86f8-99c2df674f5f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.983087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff06f-f9ea-4b30-86f8-99c2df674f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.983087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff06f-f9ea-4b30-86f8-99c2df674f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.993193 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bff06f-f9ea-4b30-86f8-99c2df674f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.994673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bff06f-f9ea-4b30-86f8-99c2df674f5f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b6bff06f-f9ea-4b30-86f8-99c2df674f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:33.010849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:33.011901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:33.013120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:33.013120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:33.013120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:33.013120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 392/758] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:33.017991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b9546-90ee-4e0d-835c-9aff51ca23a2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:33.213994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b9546-90ee-4e0d-835c-9aff51ca23a2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:33.270311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf88d6-0b47-4604-b892-76a5995aac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:33.271325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf88d6-0b47-4604-b892-76a5995aac09 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.271819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf88d6-0b47-4604-b892-76a5995aac09 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.272295 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf88d6-0b47-4604-b892-76a5995aac09 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.273183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf88d6-0b47-4604-b892-76a5995aac09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:33.273693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf88d6-0b47-4604-b892-76a5995aac09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:33.275441 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf88d6-0b47-4604-b892-76a5995aac09 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:33.289130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 367/759] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:33.299102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff06f-f9ea-4b30-86f8-99c2df674f5f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:33.326190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d0ea2-9442-4d1e-a5e2-7b5fef13f35b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.326475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d0ea2-9442-4d1e-a5e2-7b5fef13f35b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.326756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d0ea2-9442-4d1e-a5e2-7b5fef13f35b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.328140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 368/760] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:33.336415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be89c-2cbd-4a5b-88d8-b072e2fbb8d1 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.336733 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be89c-2cbd-4a5b-88d8-b072e2fbb8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.337009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be89c-2cbd-4a5b-88d8-b072e2fbb8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.363636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b78be89c-2cbd-4a5b-88d8-b072e2fbb8d1 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:33.364845 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b78be89c-2cbd-4a5b-88d8-b072e2fbb8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:33.475620 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:33.492043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:33.504266 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 369/761] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:33.524384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff06f-f9ea-4b30-86f8-99c2df674f5f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:33.563998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1e52d-9c9c-4d65-b3ac-00d8cd3c85b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:33.564944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1e52d-9c9c-4d65-b3ac-00d8cd3c85b7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.565432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1e52d-9c9c-4d65-b3ac-00d8cd3c85b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.566396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1e52d-9c9c-4d65-b3ac-00d8cd3c85b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.574133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1e52d-9c9c-4d65-b3ac-00d8cd3c85b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:33.575908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1e52d-9c9c-4d65-b3ac-00d8cd3c85b7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-18a1e52d-9c9c-4d65-b3ac-00d8cd3c85b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:33.590303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:33.591317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:33.592294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:33.592294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:33.592294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:33.592294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:33.592294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:33.592294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:33.592294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:33.592294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:33.592294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:33.592294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:33.592294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 393/762] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:33.597024 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be89c-2cbd-4a5b-88d8-b072e2fbb8d1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:33.732550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be89c-2cbd-4a5b-88d8-b072e2fbb8d1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:33.768605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72260d-f606-4fb1-b94b-9e2d708bef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:33.769220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72260d-f606-4fb1-b94b-9e2d708bef3e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.769498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72260d-f606-4fb1-b94b-9e2d708bef3e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.769771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72260d-f606-4fb1-b94b-9e2d708bef3e None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.770507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72260d-f606-4fb1-b94b-9e2d708bef3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:33.770808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72260d-f606-4fb1-b94b-9e2d708bef3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:33.772335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72260d-f606-4fb1-b94b-9e2d708bef3e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:33.790879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 370/763] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:33.796274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1e52d-9c9c-4d65-b3ac-00d8cd3c85b7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:33.864507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72260d-f606-4fb1-b94b-9e2d708bef3e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:33.919010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:33.929104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1e52d-9c9c-4d65-b3ac-00d8cd3c85b7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:33.970501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c081983-d365-4764-9818-89e95693427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:33.971162 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c081983-d365-4764-9818-89e95693427a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.971446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c081983-d365-4764-9818-89e95693427a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.971716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c081983-d365-4764-9818-89e95693427a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.996507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c081983-d365-4764-9818-89e95693427a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:33.997978 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c081983-d365-4764-9818-89e95693427a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.007321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4c081983-d365-4764-9818-89e95693427a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:34.025974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:34.026985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:34.027912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:34.027912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:34.027912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:34.032109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 394/764] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:34.037833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c081983-d365-4764-9818-89e95693427a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.075762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72260d-f606-4fb1-b94b-9e2d708bef3e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.124243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8590fe-9bb5-4e35-8c69-b2afb025ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.124904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8590fe-9bb5-4e35-8c69-b2afb025ff35 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.125187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8590fe-9bb5-4e35-8c69-b2afb025ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.125463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8590fe-9bb5-4e35-8c69-b2afb025ff35 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.126075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8590fe-9bb5-4e35-8c69-b2afb025ff35 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.128145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8590fe-9bb5-4e35-8c69-b2afb025ff35 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-4c8590fe-9bb5-4e35-8c69-b2afb025ff35 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:34.138640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:34.139745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:34.140595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 371/765] 10.222.0.88 () {56 vars in 1129 bytes} [Wed Aug 24 03:27:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:34.146536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8590fe-9bb5-4e35-8c69-b2afb025ff35 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.241817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c081983-d365-4764-9818-89e95693427a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.287095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:34.296145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8590fe-9bb5-4e35-8c69-b2afb025ff35 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.318189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d55db8-f5ca-46a6-8d73-4b63796bb1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.318845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55db8-f5ca-46a6-8d73-4b63796bb1af None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.319149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55db8-f5ca-46a6-8d73-4b63796bb1af None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.319426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55db8-f5ca-46a6-8d73-4b63796bb1af None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.320091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d55db8-f5ca-46a6-8d73-4b63796bb1af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:34.320397 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d55db8-f5ca-46a6-8d73-4b63796bb1af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.322314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d55db8-f5ca-46a6-8d73-4b63796bb1af None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.350129 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 395/766] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:34.362679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d55db8-f5ca-46a6-8d73-4b63796bb1af None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.369226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f636a-dee4-4e2a-90f2-d9485e8f4640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.369866 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f636a-dee4-4e2a-90f2-d9485e8f4640 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.370139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f636a-dee4-4e2a-90f2-d9485e8f4640 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.370418 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f636a-dee4-4e2a-90f2-d9485e8f4640 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.371087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f636a-dee4-4e2a-90f2-d9485e8f4640 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:34.371395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f636a-dee4-4e2a-90f2-d9485e8f4640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.372782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f636a-dee4-4e2a-90f2-d9485e8f4640 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.386265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 372/767] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:34.391772 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f636a-dee4-4e2a-90f2-d9485e8f4640 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.451868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:34.506566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d55db8-f5ca-46a6-8d73-4b63796bb1af None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.534693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f636a-dee4-4e2a-90f2-d9485e8f4640 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.547850 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adeed4-8e9b-48ea-b29e-61b1c7225d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.548499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adeed4-8e9b-48ea-b29e-61b1c7225d95 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.548780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adeed4-8e9b-48ea-b29e-61b1c7225d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.549056 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adeed4-8e9b-48ea-b29e-61b1c7225d95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.557110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adeed4-8e9b-48ea-b29e-61b1c7225d95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.558672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adeed4-8e9b-48ea-b29e-61b1c7225d95 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c4adeed4-8e9b-48ea-b29e-61b1c7225d95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:34.570991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:34.571966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:34.572877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:34.572877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:34.572877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:34.572877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:34.572877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:34.572877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:34.572877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:34.572877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:34.572877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 396/768] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:34.574109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cf251-f923-4d9c-ac5f-b2f7193f3439 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.574109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cf251-f923-4d9c-ac5f-b2f7193f3439 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.574109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cf251-f923-4d9c-ac5f-b2f7193f3439 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.578224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bedec-6308-4704-be4f-61a0e4f371db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.578855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bedec-6308-4704-be4f-61a0e4f371db None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.579176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bedec-6308-4704-be4f-61a0e4f371db None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.579361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 397/769] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:34.579511 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bedec-6308-4704-be4f-61a0e4f371db None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.580062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cf251-f923-4d9c-ac5f-b2f7193f3439 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.580232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bedec-6308-4704-be4f-61a0e4f371db None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:34.580379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bedec-6308-4704-be4f-61a0e4f371db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.581811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bedec-6308-4704-be4f-61a0e4f371db None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.589565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 373/770] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:34.590929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303920c-362d-4929-98c7-f9c9019f04ab None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.591244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303920c-362d-4929-98c7-f9c9019f04ab None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.591528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303920c-362d-4929-98c7-f9c9019f04ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.615521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c303920c-362d-4929-98c7-f9c9019f04ab None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:34.616873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c303920c-362d-4929-98c7-f9c9019f04ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:34.640441 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:34.708211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 374/771] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:34.709825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303920c-362d-4929-98c7-f9c9019f04ab None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.720578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cf251-f923-4d9c-ac5f-b2f7193f3439 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.764922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:34.808698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699263b6-8d71-4284-988a-0fc3b9619f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.809668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699263b6-8d71-4284-988a-0fc3b9619f00 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.810153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699263b6-8d71-4284-988a-0fc3b9619f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.810636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699263b6-8d71-4284-988a-0fc3b9619f00 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.811591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699263b6-8d71-4284-988a-0fc3b9619f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:34.812103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699263b6-8d71-4284-988a-0fc3b9619f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.813750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699263b6-8d71-4284-988a-0fc3b9619f00 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.825807 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303920c-362d-4929-98c7-f9c9019f04ab None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.840745 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 398/772] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:34.846564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699263b6-8d71-4284-988a-0fc3b9619f00 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.872997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a174-3e39-4db6-a23e-32fbcb6b7cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.873720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a174-3e39-4db6-a23e-32fbcb6b7cfb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.874005 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a174-3e39-4db6-a23e-32fbcb6b7cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.874279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01a174-3e39-4db6-a23e-32fbcb6b7cfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.875067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01a174-3e39-4db6-a23e-32fbcb6b7cfb None admin] RBAC: Adding query filter params (interface=public, service_id=552b56b81ec448bd97dc99779266bcbe, region_id=RegionOne) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:34.875388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01a174-3e39-4db6-a23e-32fbcb6b7cfb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.876820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01a174-3e39-4db6-a23e-32fbcb6b7cfb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.890296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 375/773] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/endpoints?service_id=552b56b81ec448bd97dc99779266bcbe&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:34.891643 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a174-3e39-4db6-a23e-32fbcb6b7cfb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.926258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:34.976905 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699263b6-8d71-4284-988a-0fc3b9619f00 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.022377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01a174-3e39-4db6-a23e-32fbcb6b7cfb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.031217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc77f8-15f4-4013-b99a-e40eb2231acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.032141 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc77f8-15f4-4013-b99a-e40eb2231acc None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.032581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc77f8-15f4-4013-b99a-e40eb2231acc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.033206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc77f8-15f4-4013-b99a-e40eb2231acc None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/9624bc4b2840420eb06d721a73655da4/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.035535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc77f8-15f4-4013-b99a-e40eb2231acc None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=9624bc4b2840420eb06d721a73655da4, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.037147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc77f8-15f4-4013-b99a-e40eb2231acc None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.058907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0637a-cc09-4038-9d16-cf88732bca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.059544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0637a-cc09-4038-9d16-cf88732bca24 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.059827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0637a-cc09-4038-9d16-cf88732bca24 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.060101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0637a-cc09-4038-9d16-cf88732bca24 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.060754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0637a-cc09-4038-9d16-cf88732bca24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.062124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0637a-cc09-4038-9d16-cf88732bca24 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.067516 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 376/774] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:35.068209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0637a-cc09-4038-9d16-cf88732bca24 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.121707 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 399/775] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:34 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/9624bc4b2840420eb06d721a73655da4/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:27:35.124471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9761d3-78f7-4f4d-bc4a-e2321c47b4e5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.125173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9761d3-78f7-4f4d-bc4a-e2321c47b4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.125677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9761d3-78f7-4f4d-bc4a-e2321c47b4e5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.127719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 400/776] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:35.136996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14943592-7388-4a69-b930-e8ffb4297102 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.136996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14943592-7388-4a69-b930-e8ffb4297102 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.136996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14943592-7388-4a69-b930-e8ffb4297102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.174157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-14943592-7388-4a69-b930-e8ffb4297102 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:35.177924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-14943592-7388-4a69-b930-e8ffb4297102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:35.217815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:35.243847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:35.261148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0637a-cc09-4038-9d16-cf88732bca24 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.304117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 401/777] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:35.316031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfcb87-b596-4d7b-b346-a847dc60ccc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.316720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfcb87-b596-4d7b-b346-a847dc60ccc2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.317005 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfcb87-b596-4d7b-b346-a847dc60ccc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.317282 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfcb87-b596-4d7b-b346-a847dc60ccc2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.317878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfcb87-b596-4d7b-b346-a847dc60ccc2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.319305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfcb87-b596-4d7b-b346-a847dc60ccc2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-0acfcb87-b596-4d7b-b346-a847dc60ccc2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:35.328969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:35.330045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:35.330900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 377/778] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:35 2022] GET /identity/v3/services/network => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:35.335926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14943592-7388-4a69-b930-e8ffb4297102 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.445149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14943592-7388-4a69-b930-e8ffb4297102 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.481693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16cc4e-89dd-4f2d-bf93-7d5565bbcc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.482311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16cc4e-89dd-4f2d-bf93-7d5565bbcc3b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.482598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16cc4e-89dd-4f2d-bf93-7d5565bbcc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.482872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16cc4e-89dd-4f2d-bf93-7d5565bbcc3b None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.483556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16cc4e-89dd-4f2d-bf93-7d5565bbcc3b None admin] RBAC: Adding query filter params (name=network) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:35.483860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16cc4e-89dd-4f2d-bf93-7d5565bbcc3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.485246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16cc4e-89dd-4f2d-bf93-7d5565bbcc3b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.490564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 402/779] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:35.496651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfcb87-b596-4d7b-b346-a847dc60ccc2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.605605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de680b8-3ac5-4b51-8d5b-6255a1d8b994 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.605933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de680b8-3ac5-4b51-8d5b-6255a1d8b994 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.606166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de680b8-3ac5-4b51-8d5b-6255a1d8b994 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.607690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 403/780] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:35.613441 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfcb87-b596-4d7b-b346-a847dc60ccc2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.618075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2e465-7f86-4ce8-b650-5f0d773b5d5a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.618361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2e465-7f86-4ce8-b650-5f0d773b5d5a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.618639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2e465-7f86-4ce8-b650-5f0d773b5d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.656144 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d4e2e465-7f86-4ce8-b650-5f0d773b5d5a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:35.657390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d4e2e465-7f86-4ce8-b650-5f0d773b5d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:35.659783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad00d4-41ac-462c-9007-b0b897d8ee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.661357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad00d4-41ac-462c-9007-b0b897d8ee6b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.661654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad00d4-41ac-462c-9007-b0b897d8ee6b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.661932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad00d4-41ac-462c-9007-b0b897d8ee6b None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.662581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad00d4-41ac-462c-9007-b0b897d8ee6b None admin] RBAC: Adding query filter params (type=network) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:35.662889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad00d4-41ac-462c-9007-b0b897d8ee6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.664304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad00d4-41ac-462c-9007-b0b897d8ee6b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.670907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 378/781] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:35.677110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad00d4-41ac-462c-9007-b0b897d8ee6b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.691401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:35.711950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:35.783165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 404/782] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:35.784097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2e465-7f86-4ce8-b650-5f0d773b5d5a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.829288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad00d4-41ac-462c-9007-b0b897d8ee6b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.901345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300dd2c-0a09-4ba7-bfa2-11af5c633411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.901966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300dd2c-0a09-4ba7-bfa2-11af5c633411 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.902249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300dd2c-0a09-4ba7-bfa2-11af5c633411 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.902522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300dd2c-0a09-4ba7-bfa2-11af5c633411 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.903319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300dd2c-0a09-4ba7-bfa2-11af5c633411 None admin] RBAC: Adding query filter params (interface=public, service_id=31dd490ac77d48adb0ad4f6722323a98, region_id=RegionOne) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:35.903578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300dd2c-0a09-4ba7-bfa2-11af5c633411 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.904976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300dd2c-0a09-4ba7-bfa2-11af5c633411 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.911115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 379/783] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:35 2022] GET /identity/v3/endpoints?service_id=31dd490ac77d48adb0ad4f6722323a98&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:35.917420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300dd2c-0a09-4ba7-bfa2-11af5c633411 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.969211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2e465-7f86-4ce8-b650-5f0d773b5d5a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.012969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:36.037578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65bff0-0962-44d6-ae09-dac83a2d64fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.038904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65bff0-0962-44d6-ae09-dac83a2d64fc None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.039447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65bff0-0962-44d6-ae09-dac83a2d64fc None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.039960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65bff0-0962-44d6-ae09-dac83a2d64fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.059631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300dd2c-0a09-4ba7-bfa2-11af5c633411 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.060416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65bff0-0962-44d6-ae09-dac83a2d64fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7c65bff0-0962-44d6-ae09-dac83a2d64fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:36.065346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:36.071696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:36.072537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 405/784] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:36.078201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65bff0-0962-44d6-ae09-dac83a2d64fc None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.118537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:36.130549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b027608-61b0-49bb-bff1-cd38a5853694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.131227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b027608-61b0-49bb-bff1-cd38a5853694 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.131488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b027608-61b0-49bb-bff1-cd38a5853694 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.137835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b027608-61b0-49bb-bff1-cd38a5853694 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.137835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b027608-61b0-49bb-bff1-cd38a5853694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.137835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b027608-61b0-49bb-bff1-cd38a5853694 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.140043 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 380/785] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:35 2022] GET /identity/v3/services => generated 772 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:36.140922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b027608-61b0-49bb-bff1-cd38a5853694 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.262568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b027608-61b0-49bb-bff1-cd38a5853694 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.265631 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65bff0-0962-44d6-ae09-dac83a2d64fc None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.328909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf00f74-b26d-4548-802a-fd46db49f9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.329587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00f74-b26d-4548-802a-fd46db49f9aa None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.329913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00f74-b26d-4548-802a-fd46db49f9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.330138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf00f74-b26d-4548-802a-fd46db49f9aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.333066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678995a-1c74-4fa9-81d9-c19ce22261ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.334461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678995a-1c74-4fa9-81d9-c19ce22261ab None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.335234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678995a-1c74-4fa9-81d9-c19ce22261ab None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.336001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678995a-1c74-4fa9-81d9-c19ce22261ab None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.337569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678995a-1c74-4fa9-81d9-c19ce22261ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:36.338376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678995a-1c74-4fa9-81d9-c19ce22261ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.341284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678995a-1c74-4fa9-81d9-c19ce22261ab None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.349514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf00f74-b26d-4548-802a-fd46db49f9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:36.357973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 406/786] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:36.359532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678995a-1c74-4fa9-81d9-c19ce22261ab None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.363419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-dcf00f74-b26d-4548-802a-fd46db49f9aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:36.371361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:36.372366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 381/787] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:36.386233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf00f74-b26d-4548-802a-fd46db49f9aa None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.472690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:36.498630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678995a-1c74-4fa9-81d9-c19ce22261ab None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.537090 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf00f74-b26d-4548-802a-fd46db49f9aa None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.558545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745981b-a616-46af-aa96-d5c7402e3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.559221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745981b-a616-46af-aa96-d5c7402e3888 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.559686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745981b-a616-46af-aa96-d5c7402e3888 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.559969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745981b-a616-46af-aa96-d5c7402e3888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.575382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745981b-a616-46af-aa96-d5c7402e3888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.577412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745981b-a616-46af-aa96-d5c7402e3888 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-2745981b-a616-46af-aa96-d5c7402e3888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:36.595362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:36.596404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:36.597310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:36.597310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:36.597310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:36.597649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 407/788] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:36.604553 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745981b-a616-46af-aa96-d5c7402e3888 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.615802 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b3545-2608-461d-8e3f-9361b8e7ad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.617212 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3545-2608-461d-8e3f-9361b8e7ad69 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.617537 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3545-2608-461d-8e3f-9361b8e7ad69 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.617826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b3545-2608-461d-8e3f-9361b8e7ad69 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.618624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b3545-2608-461d-8e3f-9361b8e7ad69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:36.618949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b3545-2608-461d-8e3f-9361b8e7ad69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.620489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b3545-2608-461d-8e3f-9361b8e7ad69 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.640828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 382/789] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:36.652230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b3545-2608-461d-8e3f-9361b8e7ad69 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.729618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:36.779896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b3545-2608-461d-8e3f-9361b8e7ad69 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.799395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745981b-a616-46af-aa96-d5c7402e3888 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.847873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b794e9-9e55-4836-b28a-9f2cdbcfc114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.848571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b794e9-9e55-4836-b28a-9f2cdbcfc114 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.848856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b794e9-9e55-4836-b28a-9f2cdbcfc114 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.849131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b794e9-9e55-4836-b28a-9f2cdbcfc114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.875084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e596c-04e5-4fa3-b115-b17165adc721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.875084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e596c-04e5-4fa3-b115-b17165adc721 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.875084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e596c-04e5-4fa3-b115-b17165adc721 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.875084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e596c-04e5-4fa3-b115-b17165adc721 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.875484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e596c-04e5-4fa3-b115-b17165adc721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:36.875484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e596c-04e5-4fa3-b115-b17165adc721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.875484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e596c-04e5-4fa3-b115-b17165adc721 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.878066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b794e9-9e55-4836-b28a-9f2cdbcfc114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.879562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b794e9-9e55-4836-b28a-9f2cdbcfc114 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.882392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f9b794e9-9e55-4836-b28a-9f2cdbcfc114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:36.899423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:36.900416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:36.901323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:36.901323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:36.901323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:36.901323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 383/790] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:36.904256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b794e9-9e55-4836-b28a-9f2cdbcfc114 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.906870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 408/791] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:36.919069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e596c-04e5-4fa3-b115-b17165adc721 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.031486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b794e9-9e55-4836-b28a-9f2cdbcfc114 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.063541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:37.112402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e596c-04e5-4fa3-b115-b17165adc721 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.143760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb26001-d3b0-4c7a-adaa-81d318ca4e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:37.144388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb26001-d3b0-4c7a-adaa-81d318ca4e8e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.144671 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb26001-d3b0-4c7a-adaa-81d318ca4e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.144946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb26001-d3b0-4c7a-adaa-81d318ca4e8e None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.145609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb26001-d3b0-4c7a-adaa-81d318ca4e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:37.145915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb26001-d3b0-4c7a-adaa-81d318ca4e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:37.147321 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb26001-d3b0-4c7a-adaa-81d318ca4e8e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:37.153073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48143fd-7198-401e-ad16-a40904b07320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:37.153860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48143fd-7198-401e-ad16-a40904b07320 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.155548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48143fd-7198-401e-ad16-a40904b07320 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.155548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48143fd-7198-401e-ad16-a40904b07320 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.165354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48143fd-7198-401e-ad16-a40904b07320 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:37.167780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48143fd-7198-401e-ad16-a40904b07320 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:37.170553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 384/792] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:37.176065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb26001-d3b0-4c7a-adaa-81d318ca4e8e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d48143fd-7198-401e-ad16-a40904b07320 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:37.180848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:37.182973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:37.185264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:37.185264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:37.185264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:37.185264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:37.185264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:37.185264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:37.185264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:37.185264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:37.185264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:37.185264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:37.185264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 409/793] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:37.194066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48143fd-7198-401e-ad16-a40904b07320 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.295314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:37.364169 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb26001-d3b0-4c7a-adaa-81d318ca4e8e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.379999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48143fd-7198-401e-ad16-a40904b07320 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.404980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd264bd4-a8ca-403c-81a9-18ac974a41f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:37.405618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd264bd4-a8ca-403c-81a9-18ac974a41f9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.405902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd264bd4-a8ca-403c-81a9-18ac974a41f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.406173 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd264bd4-a8ca-403c-81a9-18ac974a41f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.413684 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd264bd4-a8ca-403c-81a9-18ac974a41f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:37.423070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd264bd4-a8ca-403c-81a9-18ac974a41f9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:37.423218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b9e30-8d06-400e-8120-628da113a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:37.423218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9e30-8d06-400e-8120-628da113a897 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.423489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9e30-8d06-400e-8120-628da113a897 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.423894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b9e30-8d06-400e-8120-628da113a897 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.424707 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b9e30-8d06-400e-8120-628da113a897 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:37.425089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b9e30-8d06-400e-8120-628da113a897 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:37.426705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b9e30-8d06-400e-8120-628da113a897 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-fd264bd4-a8ca-403c-81a9-18ac974a41f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:37.427603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:37.428523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:37.429506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:37.429506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:37.429506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:37.429506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:37.429506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:37.429506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:37.429506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:37.429506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:37.429506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:37.429506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:37.434015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 385/794] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:37.435356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef519-1d0c-419c-87b1-aa3e87d783c9 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.435647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef519-1d0c-419c-87b1-aa3e87d783c9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.435923 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef519-1d0c-419c-87b1-aa3e87d783c9 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.441748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 386/795] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:37.443938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedef519-1d0c-419c-87b1-aa3e87d783c9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.453748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 410/796] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:37.455027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8797af-d3ae-4885-87ec-a907d34a6601 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.455593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8797af-d3ae-4885-87ec-a907d34a6601 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.455881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8797af-d3ae-4885-87ec-a907d34a6601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.479492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:37.480883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9b8797af-d3ae-4885-87ec-a907d34a6601 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:37.482589 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b8797af-d3ae-4885-87ec-a907d34a6601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:37.570701 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedef519-1d0c-419c-87b1-aa3e87d783c9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.579531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 411/797] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:37.580226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8797af-d3ae-4885-87ec-a907d34a6601 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.635419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161dfa2-765d-4ae0-ae5e-69c0d0b84b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:37.636058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161dfa2-765d-4ae0-ae5e-69c0d0b84b1a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.636273 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161dfa2-765d-4ae0-ae5e-69c0d0b84b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.636548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161dfa2-765d-4ae0-ae5e-69c0d0b84b1a None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.637293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161dfa2-765d-4ae0-ae5e-69c0d0b84b1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:37.637600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161dfa2-765d-4ae0-ae5e-69c0d0b84b1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:37.642577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161dfa2-765d-4ae0-ae5e-69c0d0b84b1a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:37.659869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:37.670383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 387/798] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:37.671783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c796-033d-4bc8-8e03-01fb6ce4ea83 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.672076 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c796-033d-4bc8-8e03-01fb6ce4ea83 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.672358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66c796-033d-4bc8-8e03-01fb6ce4ea83 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.677784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 388/799] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:37.678584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66c796-033d-4bc8-8e03-01fb6ce4ea83 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.719451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8797af-d3ae-4885-87ec-a907d34a6601 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.755010 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292de01-427d-4158-857b-5dfe3eb9eb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:37.755797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292de01-427d-4158-857b-5dfe3eb9eb41 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.756146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292de01-427d-4158-857b-5dfe3eb9eb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.756539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292de01-427d-4158-857b-5dfe3eb9eb41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.767299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292de01-427d-4158-857b-5dfe3eb9eb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:37.768863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292de01-427d-4158-857b-5dfe3eb9eb41 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:37.779458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f292de01-427d-4158-857b-5dfe3eb9eb41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:37.783903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:37.784863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:37.785768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:37.785768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:37.785768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:37.785768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 412/800] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:37.787038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430741-967d-4a87-ab31-040a57418cd2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.787255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66c796-033d-4bc8-8e03-01fb6ce4ea83 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.787451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430741-967d-4a87-ab31-040a57418cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.787790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430741-967d-4a87-ab31-040a57418cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.813489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a6430741-967d-4a87-ab31-040a57418cd2 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:37.814967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a6430741-967d-4a87-ab31-040a57418cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:37.828183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d3dd-01d1-43ad-becd-933f095786cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:37.829231 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d3dd-01d1-43ad-becd-933f095786cf None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.829522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d3dd-01d1-43ad-becd-933f095786cf None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.829855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d3dd-01d1-43ad-becd-933f095786cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.846476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d3dd-01d1-43ad-becd-933f095786cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:37.848184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d3dd-01d1-43ad-becd-933f095786cf None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-d3e9d3dd-01d1-43ad-becd-933f095786cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:37.872606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:37.873732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:37.874672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:37.874672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:37.874672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:37.874672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 389/801] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:37.874672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d3dd-01d1-43ad-becd-933f095786cf None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.904393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 413/802] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:37.905456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6430741-967d-4a87-ab31-040a57418cd2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.935267 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:37.995159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d3dd-01d1-43ad-becd-933f095786cf None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.033311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac69ba7-9260-461b-b920-befcd60c82a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.034065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac69ba7-9260-461b-b920-befcd60c82a0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.034351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac69ba7-9260-461b-b920-befcd60c82a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.034682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac69ba7-9260-461b-b920-befcd60c82a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.035389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac69ba7-9260-461b-b920-befcd60c82a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:38.035862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac69ba7-9260-461b-b920-befcd60c82a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.037869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac69ba7-9260-461b-b920-befcd60c82a0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.040734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6430741-967d-4a87-ab31-040a57418cd2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.054469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 390/803] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:38.055833 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac69ba7-9260-461b-b920-befcd60c82a0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.059322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.085511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c048-89d1-4583-8dc5-04a0beba7173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.087098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c048-89d1-4583-8dc5-04a0beba7173 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.087564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c048-89d1-4583-8dc5-04a0beba7173 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.088029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c048-89d1-4583-8dc5-04a0beba7173 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.088845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744c048-89d1-4583-8dc5-04a0beba7173 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.090501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744c048-89d1-4583-8dc5-04a0beba7173 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c744c048-89d1-4583-8dc5-04a0beba7173 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:38.101149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:38.102199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:38.103088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:38.106098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 414/804] 10.222.0.88 () {56 vars in 1129 bytes} [Wed Aug 24 03:27:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:38.107166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c048-89d1-4583-8dc5-04a0beba7173 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.191168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac69ba7-9260-461b-b920-befcd60c82a0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.209519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.224968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c048-89d1-4583-8dc5-04a0beba7173 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.229109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a5be8-e212-45c5-8b17-a241100dc1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.237980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a5be8-e212-45c5-8b17-a241100dc1ac None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.237980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a5be8-e212-45c5-8b17-a241100dc1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.237980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a5be8-e212-45c5-8b17-a241100dc1ac None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.237980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a5be8-e212-45c5-8b17-a241100dc1ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:38.237980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a5be8-e212-45c5-8b17-a241100dc1ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.237980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a5be8-e212-45c5-8b17-a241100dc1ac None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.245588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 391/805] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:38.246708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a5be8-e212-45c5-8b17-a241100dc1ac None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.273616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a012445-e5a5-43b9-b148-13ebe2ca4db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.274780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012445-e5a5-43b9-b148-13ebe2ca4db3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.275084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012445-e5a5-43b9-b148-13ebe2ca4db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.275354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012445-e5a5-43b9-b148-13ebe2ca4db3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.282441 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a012445-e5a5-43b9-b148-13ebe2ca4db3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.283989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a012445-e5a5-43b9-b148-13ebe2ca4db3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1a012445-e5a5-43b9-b148-13ebe2ca4db3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:38.295133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:38.296039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:38.297123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:38.297123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:38.297123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:38.297123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:38.297123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:38.297123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:38.297123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:38.297123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:38.301145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 415/806] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:38.302000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a012445-e5a5-43b9-b148-13ebe2ca4db3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.319397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.364818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a5be8-e212-45c5-8b17-a241100dc1ac None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.400199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36dbb7-0932-4894-a73e-dc6a133135f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.400812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36dbb7-0932-4894-a73e-dc6a133135f9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.401089 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36dbb7-0932-4894-a73e-dc6a133135f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.401363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36dbb7-0932-4894-a73e-dc6a133135f9 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.402008 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36dbb7-0932-4894-a73e-dc6a133135f9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:38.402438 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36dbb7-0932-4894-a73e-dc6a133135f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.403725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36dbb7-0932-4894-a73e-dc6a133135f9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.411022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a012445-e5a5-43b9-b148-13ebe2ca4db3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.416572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 392/807] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:38.417408 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36dbb7-0932-4894-a73e-dc6a133135f9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.446416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7545efc-bec0-4aab-b2f2-7cf1df3476cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.446977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545efc-bec0-4aab-b2f2-7cf1df3476cd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.447287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545efc-bec0-4aab-b2f2-7cf1df3476cd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.447564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545efc-bec0-4aab-b2f2-7cf1df3476cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.457689 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7545efc-bec0-4aab-b2f2-7cf1df3476cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b7545efc-bec0-4aab-b2f2-7cf1df3476cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:38.462420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:38.463559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 416/808] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:38.464740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7545efc-bec0-4aab-b2f2-7cf1df3476cd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.477585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.522355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36dbb7-0932-4894-a73e-dc6a133135f9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.547470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.560701 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156a97d-234a-437b-a87d-ea6ad2c5c882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.561381 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156a97d-234a-437b-a87d-ea6ad2c5c882 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.561618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156a97d-234a-437b-a87d-ea6ad2c5c882 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.561882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156a97d-234a-437b-a87d-ea6ad2c5c882 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.569406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7545efc-bec0-4aab-b2f2-7cf1df3476cd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.571385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156a97d-234a-437b-a87d-ea6ad2c5c882 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.573042 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156a97d-234a-437b-a87d-ea6ad2c5c882 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-3156a97d-234a-437b-a87d-ea6ad2c5c882 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:38.584144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:38.585038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:38.585939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:38.585939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:38.585939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:38.585939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:38.585939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:38.585939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:38.585939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:38.585939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:38.585939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 393/809] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:38.586468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6d51d-a82b-4b8e-a724-0dc663d50c80 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.586686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6d51d-a82b-4b8e-a724-0dc663d50c80 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.586988 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6d51d-a82b-4b8e-a724-0dc663d50c80 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.588161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 394/810] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:38.588853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6d51d-a82b-4b8e-a724-0dc663d50c80 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.608173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4631642-345b-42dd-8fd0-2a56cddf947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.608786 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631642-345b-42dd-8fd0-2a56cddf947d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.609068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631642-345b-42dd-8fd0-2a56cddf947d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.609343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631642-345b-42dd-8fd0-2a56cddf947d None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.610042 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631642-345b-42dd-8fd0-2a56cddf947d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:38.610347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631642-345b-42dd-8fd0-2a56cddf947d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.611824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631642-345b-42dd-8fd0-2a56cddf947d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.624139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 417/811] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:38.624935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4631642-345b-42dd-8fd0-2a56cddf947d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.691178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.694506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6d51d-a82b-4b8e-a724-0dc663d50c80 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.725462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4631642-345b-42dd-8fd0-2a56cddf947d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.728258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8f79-71eb-4f01-89aa-70751fb37020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.728891 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8f79-71eb-4f01-89aa-70751fb37020 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.729332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8f79-71eb-4f01-89aa-70751fb37020 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.729690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8f79-71eb-4f01-89aa-70751fb37020 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.730612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b8f79-71eb-4f01-89aa-70751fb37020 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:38.730920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b8f79-71eb-4f01-89aa-70751fb37020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.732323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b8f79-71eb-4f01-89aa-70751fb37020 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.737095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 395/812] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:38.737878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8f79-71eb-4f01-89aa-70751fb37020 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.764992 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968badde-d509-4aae-8b35-7d4b298ef7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.765607 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968badde-d509-4aae-8b35-7d4b298ef7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.765886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968badde-d509-4aae-8b35-7d4b298ef7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.766166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968badde-d509-4aae-8b35-7d4b298ef7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.766840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968badde-d509-4aae-8b35-7d4b298ef7d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:38.767214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968badde-d509-4aae-8b35-7d4b298ef7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.768589 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968badde-d509-4aae-8b35-7d4b298ef7d3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.776673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 418/813] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:38.778244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9138b-2e4f-4a8f-bd80-ea310f1ed19c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.778528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9138b-2e4f-4a8f-bd80-ea310f1ed19c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.778802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9138b-2e4f-4a8f-bd80-ea310f1ed19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.788010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.797465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-40d9138b-2e4f-4a8f-bd80-ea310f1ed19c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:38.798665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-40d9138b-2e4f-4a8f-bd80-ea310f1ed19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:38.839260 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8f79-71eb-4f01-89aa-70751fb37020 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.868218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 419/814] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:38.869058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9138b-2e4f-4a8f-bd80-ea310f1ed19c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.879575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded73ae7-1e86-4b10-bc05-05b656fc49b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.880183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded73ae7-1e86-4b10-bc05-05b656fc49b4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.880471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded73ae7-1e86-4b10-bc05-05b656fc49b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.880748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded73ae7-1e86-4b10-bc05-05b656fc49b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.881450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded73ae7-1e86-4b10-bc05-05b656fc49b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:38.881759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded73ae7-1e86-4b10-bc05-05b656fc49b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.883245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded73ae7-1e86-4b10-bc05-05b656fc49b4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.895737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 396/815] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:38.896550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded73ae7-1e86-4b10-bc05-05b656fc49b4 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.941678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.988596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9138b-2e4f-4a8f-bd80-ea310f1ed19c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.018050 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded73ae7-1e86-4b10-bc05-05b656fc49b4 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.026583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251d59d-7f3d-4dc8-86c0-a239244662af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.027439 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251d59d-7f3d-4dc8-86c0-a239244662af None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.027727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251d59d-7f3d-4dc8-86c0-a239244662af None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.030653 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251d59d-7f3d-4dc8-86c0-a239244662af None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/d4052d31496a46948211cd4b7d38808b/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.030771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.030852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251d59d-7f3d-4dc8-86c0-a239244662af None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=d4052d31496a46948211cd4b7d38808b, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.032207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251d59d-7f3d-4dc8-86c0-a239244662af None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.051681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4b271-f38f-4b0d-8fad-f91990fa9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.052284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b271-f38f-4b0d-8fad-f91990fa9fe9 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.052559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b271-f38f-4b0d-8fad-f91990fa9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.052826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4b271-f38f-4b0d-8fad-f91990fa9fe9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.053478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4b271-f38f-4b0d-8fad-f91990fa9fe9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.054826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4b271-f38f-4b0d-8fad-f91990fa9fe9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.159263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 420/816] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:38 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/d4052d31496a46948211cd4b7d38808b/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:39.160016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251d59d-7f3d-4dc8-86c0-a239244662af None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.185565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 397/817] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:39.186285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4b271-f38f-4b0d-8fad-f91990fa9fe9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.303633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251d59d-7f3d-4dc8-86c0-a239244662af None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.331927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.357369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eb465-9c57-428a-a46f-a42e5adafe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.358072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eb465-9c57-428a-a46f-a42e5adafe12 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.358351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eb465-9c57-428a-a46f-a42e5adafe12 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.358622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eb465-9c57-428a-a46f-a42e5adafe12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.360469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4b271-f38f-4b0d-8fad-f91990fa9fe9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.372754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622eb465-9c57-428a-a46f-a42e5adafe12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.374985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622eb465-9c57-428a-a46f-a42e5adafe12 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-622eb465-9c57-428a-a46f-a42e5adafe12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:39.391844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:39.392892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:39.393802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:39.393802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:39.393802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:39.395134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 421/818] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:39.395998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eb465-9c57-428a-a46f-a42e5adafe12 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.409603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bb9b2-9e95-423c-85dd-9a5468a99331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.410091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb9b2-9e95-423c-85dd-9a5468a99331 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.411293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb9b2-9e95-423c-85dd-9a5468a99331 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.411293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb9b2-9e95-423c-85dd-9a5468a99331 None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/d33c67fc513e49df9f6792475ff2d20e/roles/09f0dc52983d44cfad84d8c3c4fc4384` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.428309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bb9b2-9e95-423c-85dd-9a5468a99331 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=d33c67fc513e49df9f6792475ff2d20e, role_id=09f0dc52983d44cfad84d8c3c4fc4384)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.429794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bb9b2-9e95-423c-85dd-9a5468a99331 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.504413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 398/819] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:39 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/d33c67fc513e49df9f6792475ff2d20e/roles/09f0dc52983d44cfad84d8c3c4fc4384 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:39.506326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bb9b2-9e95-423c-85dd-9a5468a99331 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.512814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eb465-9c57-428a-a46f-a42e5adafe12 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.527499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.554542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33df66-fc07-4f66-b5c5-253274b2b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.555747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33df66-fc07-4f66-b5c5-253274b2b1ab None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.556030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33df66-fc07-4f66-b5c5-253274b2b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.556302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33df66-fc07-4f66-b5c5-253274b2b1ab None admin] PATH_INFO: `/v3/services/network` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.557027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33df66-fc07-4f66-b5c5-253274b2b1ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.559136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33df66-fc07-4f66-b5c5-253274b2b1ab None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-9d33df66-fc07-4f66-b5c5-253274b2b1ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:39.571139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:39.572283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:39.573241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:39.576822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 422/820] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:39.583104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33df66-fc07-4f66-b5c5-253274b2b1ab None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.643582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.683134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bb9b2-9e95-423c-85dd-9a5468a99331 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.746843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb5939-dd1a-468b-a4f1-9224fd35dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.747546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb5939-dd1a-468b-a4f1-9224fd35dc03 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.747766 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb5939-dd1a-468b-a4f1-9224fd35dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.748044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb5939-dd1a-468b-a4f1-9224fd35dc03 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.748729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb5939-dd1a-468b-a4f1-9224fd35dc03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:39.749011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb5939-dd1a-468b-a4f1-9224fd35dc03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.750398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb5939-dd1a-468b-a4f1-9224fd35dc03 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.775289 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 399/821] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:39.788141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb5939-dd1a-468b-a4f1-9224fd35dc03 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.791401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33df66-fc07-4f66-b5c5-253274b2b1ab None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.829020 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18c62a-f990-4fce-afc3-cb38a05f5108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.829549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c62a-f990-4fce-afc3-cb38a05f5108 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.829832 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c62a-f990-4fce-afc3-cb38a05f5108 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.830109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c62a-f990-4fce-afc3-cb38a05f5108 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.830744 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18c62a-f990-4fce-afc3-cb38a05f5108 None admin] RBAC: Adding query filter params (name=network) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:39.831071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18c62a-f990-4fce-afc3-cb38a05f5108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.832477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18c62a-f990-4fce-afc3-cb38a05f5108 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.841342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 423/822] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:39.848940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18c62a-f990-4fce-afc3-cb38a05f5108 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.961399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.997262 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb5939-dd1a-468b-a4f1-9224fd35dc03 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.020392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18c62a-f990-4fce-afc3-cb38a05f5108 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.022324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.056246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e02979-8b47-4e00-835f-9928574daab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.063071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e02979-8b47-4e00-835f-9928574daab4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.063071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e02979-8b47-4e00-835f-9928574daab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.063071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e02979-8b47-4e00-835f-9928574daab4 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.063071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e02979-8b47-4e00-835f-9928574daab4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:40.063071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e02979-8b47-4e00-835f-9928574daab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.063071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e02979-8b47-4e00-835f-9928574daab4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.066053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd04d4-d4eb-4410-a128-5b970c52908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.066053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd04d4-d4eb-4410-a128-5b970c52908b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.066053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd04d4-d4eb-4410-a128-5b970c52908b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.066053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd04d4-d4eb-4410-a128-5b970c52908b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.066540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 424/823] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:40.072161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e02979-8b47-4e00-835f-9928574daab4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.083896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd04d4-d4eb-4410-a128-5b970c52908b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.085623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd04d4-d4eb-4410-a128-5b970c52908b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-d9bd04d4-d4eb-4410-a128-5b970c52908b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:40.099348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:40.100357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:40.101365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:40.101365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:40.101365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:40.101365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:40.101365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:40.101365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:40.101365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:40.101365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:40.101365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:40.101365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:40.109803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 400/824] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:40.110700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd04d4-d4eb-4410-a128-5b970c52908b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.185133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e02979-8b47-4e00-835f-9928574daab4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.220898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b64121-166a-4d33-82e8-9e6c2c309864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.221616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64121-166a-4d33-82e8-9e6c2c309864 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.221875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64121-166a-4d33-82e8-9e6c2c309864 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.222153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64121-166a-4d33-82e8-9e6c2c309864 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.222834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b64121-166a-4d33-82e8-9e6c2c309864 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.232335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b64121-166a-4d33-82e8-9e6c2c309864 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.279400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd04d4-d4eb-4410-a128-5b970c52908b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.324326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.329861 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627a62-5e81-49b9-acba-5502c6fd6a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.330541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627a62-5e81-49b9-acba-5502c6fd6a5f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.330828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627a62-5e81-49b9-acba-5502c6fd6a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.331129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627a62-5e81-49b9-acba-5502c6fd6a5f None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.331932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31627a62-5e81-49b9-acba-5502c6fd6a5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:40.332299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31627a62-5e81-49b9-acba-5502c6fd6a5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.333743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31627a62-5e81-49b9-acba-5502c6fd6a5f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.353112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 425/825] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:40.354142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 401/826] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:40.364491 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b64121-166a-4d33-82e8-9e6c2c309864 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.400836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.539200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b64121-166a-4d33-82e8-9e6c2c309864 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.589266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a386d-2ea9-45cb-84f5-823309b7159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.589892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a386d-2ea9-45cb-84f5-823309b7159b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.590169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a386d-2ea9-45cb-84f5-823309b7159b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.590438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a386d-2ea9-45cb-84f5-823309b7159b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.698988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a386d-2ea9-45cb-84f5-823309b7159b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.700415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a386d-2ea9-45cb-84f5-823309b7159b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.727603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.828091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 426/827] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:40.833725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627a62-5e81-49b9-acba-5502c6fd6a5f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.949783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627a62-5e81-49b9-acba-5502c6fd6a5f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.989911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71011a62-2391-49bd-8641-8dede349d95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.990609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011a62-2391-49bd-8641-8dede349d95a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.990896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011a62-2391-49bd-8641-8dede349d95a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.991203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011a62-2391-49bd-8641-8dede349d95a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.002422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71011a62-2391-49bd-8641-8dede349d95a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.003915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71011a62-2391-49bd-8641-8dede349d95a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-71011a62-2391-49bd-8641-8dede349d95a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:41.021899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:41.022902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:41.024077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:41.024077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:41.024077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:41.024077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 402/828] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:41.029507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a386d-2ea9-45cb-84f5-823309b7159b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.156756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a386d-2ea9-45cb-84f5-823309b7159b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.170370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.201190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f67e-f42b-4764-a388-a211632b80be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.202125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f67e-f42b-4764-a388-a211632b80be None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.202495 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f67e-f42b-4764-a388-a211632b80be None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.202772 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f67e-f42b-4764-a388-a211632b80be None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.203870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905f67e-f42b-4764-a388-a211632b80be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:41.204542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905f67e-f42b-4764-a388-a211632b80be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.206131 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905f67e-f42b-4764-a388-a211632b80be None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.223082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 427/829] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:41.228445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71011a62-2391-49bd-8641-8dede349d95a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.276269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.339474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71011a62-2391-49bd-8641-8dede349d95a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.375152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816f55e-a6a1-4c1f-8298-e22f1c445ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.375792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816f55e-a6a1-4c1f-8298-e22f1c445ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.376073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816f55e-a6a1-4c1f-8298-e22f1c445ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.376348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816f55e-a6a1-4c1f-8298-e22f1c445ba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.384233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816f55e-a6a1-4c1f-8298-e22f1c445ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.385786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816f55e-a6a1-4c1f-8298-e22f1c445ba2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.386065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3c98-e207-4b6c-a52d-d706a86a83e4 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.386498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3c98-e207-4b6c-a52d-d706a86a83e4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.386598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3c98-e207-4b6c-a52d-d706a86a83e4 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.388225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 428/830] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:41.396692 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8bf37-5ee4-4621-b298-ae994b1af2a6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.397160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8bf37-5ee4-4621-b298-ae994b1af2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.397585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8bf37-5ee4-4621-b298-ae994b1af2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-8816f55e-a6a1-4c1f-8298-e22f1c445ba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:41.400717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:41.401710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:41.402626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:41.402626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:41.402626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:41.402626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:41.402626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:41.402626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:41.402626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:41.402626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:41.402626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 403/831] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:41.407995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816f55e-a6a1-4c1f-8298-e22f1c445ba2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.422261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-19e8bf37-5ee4-4621-b298-ae994b1af2a6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:41.424291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-19e8bf37-5ee4-4621-b298-ae994b1af2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:41.496517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 429/832] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:41.497782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d116d60-91c0-4dc7-ae33-1ff4cc5cfcba None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.498067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d116d60-91c0-4dc7-ae33-1ff4cc5cfcba None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.498344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d116d60-91c0-4dc7-ae33-1ff4cc5cfcba None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.500139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 430/833] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:41.505433 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf855cf-f78d-4944-b00e-5e5cc00febd8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.505721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf855cf-f78d-4944-b00e-5e5cc00febd8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.505995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf855cf-f78d-4944-b00e-5e5cc00febd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.524145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4bf855cf-f78d-4944-b00e-5e5cc00febd8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:41.525332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4bf855cf-f78d-4944-b00e-5e5cc00febd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:41.529375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816f55e-a6a1-4c1f-8298-e22f1c445ba2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.531311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.576035 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1c6e4-a141-405c-89ea-2056338c56d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.576642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1c6e4-a141-405c-89ea-2056338c56d5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.576922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1c6e4-a141-405c-89ea-2056338c56d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.577192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1c6e4-a141-405c-89ea-2056338c56d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.577991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1c6e4-a141-405c-89ea-2056338c56d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:41.578352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1c6e4-a141-405c-89ea-2056338c56d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.579873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1c6e4-a141-405c-89ea-2056338c56d5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.595751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 404/834] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:41.601475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1c6e4-a141-405c-89ea-2056338c56d5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.619088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 431/835] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:41.705043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4eb3e-2151-4293-bdd1-4fd10c0af3dd None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.705387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4eb3e-2151-4293-bdd1-4fd10c0af3dd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.705628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4eb3e-2151-4293-bdd1-4fd10c0af3dd None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.712907 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 432/836] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:41.714724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaa31a-8a00-41c4-b99c-c5c3f225603c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.715115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaa31a-8a00-41c4-b99c-c5c3f225603c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.715474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaa31a-8a00-41c4-b99c-c5c3f225603c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.724620 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1c6e4-a141-405c-89ea-2056338c56d5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.735897 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1eaaa31a-8a00-41c4-b99c-c5c3f225603c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:41.737289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1eaaa31a-8a00-41c4-b99c-c5c3f225603c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:41.766570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.770053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee36e3-4521-40b4-a068-4c9c27a40994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.770824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee36e3-4521-40b4-a068-4c9c27a40994 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.771216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee36e3-4521-40b4-a068-4c9c27a40994 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.771877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee36e3-4521-40b4-a068-4c9c27a40994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.772921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee36e3-4521-40b4-a068-4c9c27a40994 None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=9624bc4b2840420eb06d721a73655da4) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:41.773246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee36e3-4521-40b4-a068-4c9c27a40994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.775660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee36e3-4521-40b4-a068-4c9c27a40994 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.781873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 405/837] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/role_assignments?user.id=9624bc4b2840420eb06d721a73655da4&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:41.782690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee36e3-4521-40b4-a068-4c9c27a40994 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.817269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.821025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 433/838] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:41.903611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee36e3-4521-40b4-a068-4c9c27a40994 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.909547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaa31a-8a00-41c4-b99c-c5c3f225603c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.942402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58c04-21f8-4a4e-8616-7582d8e06bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.943152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58c04-21f8-4a4e-8616-7582d8e06bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.943441 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58c04-21f8-4a4e-8616-7582d8e06bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.943891 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef58c04-21f8-4a4e-8616-7582d8e06bd5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.944502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58c04-21f8-4a4e-8616-7582d8e06bd5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.946037 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef58c04-21f8-4a4e-8616-7582d8e06bd5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-2ef58c04-21f8-4a4e-8616-7582d8e06bd5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:41.958174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:41.959238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:41.960093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 406/839] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:41.965804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58c04-21f8-4a4e-8616-7582d8e06bd5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.034935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaa31a-8a00-41c4-b99c-c5c3f225603c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.079643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c403872-f4ca-43e3-b21e-e2ae90b0c1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.080773 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.080890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c403872-f4ca-43e3-b21e-e2ae90b0c1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.081657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c403872-f4ca-43e3-b21e-e2ae90b0c1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.082006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c403872-f4ca-43e3-b21e-e2ae90b0c1e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.091858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef58c04-21f8-4a4e-8616-7582d8e06bd5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.097028 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c403872-f4ca-43e3-b21e-e2ae90b0c1e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1c403872-f4ca-43e3-b21e-e2ae90b0c1e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:42.103447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:42.104449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:42.105541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 434/840] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:42.112082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c403872-f4ca-43e3-b21e-e2ae90b0c1e2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.137056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a96016-6e0b-46cf-a577-357a304ec551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.137677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a96016-6e0b-46cf-a577-357a304ec551 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.137961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a96016-6e0b-46cf-a577-357a304ec551 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.138239 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a96016-6e0b-46cf-a577-357a304ec551 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.138883 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a96016-6e0b-46cf-a577-357a304ec551 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:42.139232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a96016-6e0b-46cf-a577-357a304ec551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.140639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a96016-6e0b-46cf-a577-357a304ec551 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.144055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.146275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 407/841] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:42.147094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a96016-6e0b-46cf-a577-357a304ec551 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.233030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c403872-f4ca-43e3-b21e-e2ae90b0c1e2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.252946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a96016-6e0b-46cf-a577-357a304ec551 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.270819 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af8f78-9494-4971-96fb-1f2074a1ad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.271453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af8f78-9494-4971-96fb-1f2074a1ad4f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.271739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af8f78-9494-4971-96fb-1f2074a1ad4f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.272003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af8f78-9494-4971-96fb-1f2074a1ad4f None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.272807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af8f78-9494-4971-96fb-1f2074a1ad4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:42.273112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af8f78-9494-4971-96fb-1f2074a1ad4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.274545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af8f78-9494-4971-96fb-1f2074a1ad4f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.283361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 435/842] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:42.284163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af8f78-9494-4971-96fb-1f2074a1ad4f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.300742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d513c5-46d1-4333-bba2-3d92dac7f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.301318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d513c5-46d1-4333-bba2-3d92dac7f5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.301607 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d513c5-46d1-4333-bba2-3d92dac7f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.301887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d513c5-46d1-4333-bba2-3d92dac7f5a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.313631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d513c5-46d1-4333-bba2-3d92dac7f5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-02d513c5-46d1-4333-bba2-3d92dac7f5a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:42.318484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:42.319705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:42.320751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 408/843] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:42.323918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d513c5-46d1-4333-bba2-3d92dac7f5a2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.344740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.380334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.397891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af8f78-9494-4971-96fb-1f2074a1ad4f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.439107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7b0bc-a43e-43b0-a8e6-51d7ccc1ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.439729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7b0bc-a43e-43b0-a8e6-51d7ccc1ec0e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.440014 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7b0bc-a43e-43b0-a8e6-51d7ccc1ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.440293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7b0bc-a43e-43b0-a8e6-51d7ccc1ec0e None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.440398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d513c5-46d1-4333-bba2-3d92dac7f5a2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.440938 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7b0bc-a43e-43b0-a8e6-51d7ccc1ec0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:42.441250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7b0bc-a43e-43b0-a8e6-51d7ccc1ec0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.442642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7b0bc-a43e-43b0-a8e6-51d7ccc1ec0e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.450251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 436/844] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:42.452068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7b0bc-a43e-43b0-a8e6-51d7ccc1ec0e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.496092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b8ebd-fa0f-4eed-9417-e78f542cee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.497765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b8ebd-fa0f-4eed-9417-e78f542cee55 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.498226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b8ebd-fa0f-4eed-9417-e78f542cee55 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.498686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b8ebd-fa0f-4eed-9417-e78f542cee55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.514200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b8ebd-fa0f-4eed-9417-e78f542cee55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.517389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b8ebd-fa0f-4eed-9417-e78f542cee55 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-183b8ebd-fa0f-4eed-9417-e78f542cee55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:42.538954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:42.540046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:42.540941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:42.540941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:42.540941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:42.545553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 409/845] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:42.547180 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b8ebd-fa0f-4eed-9417-e78f542cee55 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.590091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7b0bc-a43e-43b0-a8e6-51d7ccc1ec0e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.634311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.635578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80bca-ea39-41ed-b458-df48c520dbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.636195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80bca-ea39-41ed-b458-df48c520dbca None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.636616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80bca-ea39-41ed-b458-df48c520dbca None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.636756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80bca-ea39-41ed-b458-df48c520dbca None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.637403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c80bca-ea39-41ed-b458-df48c520dbca None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:42.637687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c80bca-ea39-41ed-b458-df48c520dbca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.639107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c80bca-ea39-41ed-b458-df48c520dbca None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.651976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 437/846] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:42.658924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80bca-ea39-41ed-b458-df48c520dbca None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.676148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.677023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b8ebd-fa0f-4eed-9417-e78f542cee55 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.716692 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad4eac-7ebc-4a75-9f6b-00c1fc37609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.717709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad4eac-7ebc-4a75-9f6b-00c1fc37609f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.718199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad4eac-7ebc-4a75-9f6b-00c1fc37609f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.718718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad4eac-7ebc-4a75-9f6b-00c1fc37609f None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.719771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad4eac-7ebc-4a75-9f6b-00c1fc37609f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:42.720380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad4eac-7ebc-4a75-9f6b-00c1fc37609f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.722039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad4eac-7ebc-4a75-9f6b-00c1fc37609f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.736645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 410/847] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:42.742968 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad4eac-7ebc-4a75-9f6b-00c1fc37609f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.778105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80bca-ea39-41ed-b458-df48c520dbca None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.814864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764b450-b82a-4548-8683-c7178becf048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.815453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764b450-b82a-4548-8683-c7178becf048 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.815732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764b450-b82a-4548-8683-c7178becf048 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.816001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764b450-b82a-4548-8683-c7178becf048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.828256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764b450-b82a-4548-8683-c7178becf048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.829719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764b450-b82a-4548-8683-c7178becf048 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-6764b450-b82a-4548-8683-c7178becf048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:42.845169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:42.846164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:42.847118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:42.847118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:42.847118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:42.847118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 438/848] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:42.852325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764b450-b82a-4548-8683-c7178becf048 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.862550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad4eac-7ebc-4a75-9f6b-00c1fc37609f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.896884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.907512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ccf28-4805-4f06-80ef-466c3873d6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.908285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ccf28-4805-4f06-80ef-466c3873d6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.908632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ccf28-4805-4f06-80ef-466c3873d6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.908971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ccf28-4805-4f06-80ef-466c3873d6a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.919305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ccf28-4805-4f06-80ef-466c3873d6a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.921704 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ccf28-4805-4f06-80ef-466c3873d6a5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.935120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-b10ccf28-4805-4f06-80ef-466c3873d6a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:42.939309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:42.940280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:42.941232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:42.941232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:42.941232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:42.941232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:42.941232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:42.941232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:42.941232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:42.941232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:42.941232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:42.941232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:42.947536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 411/849] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:42.950770 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ccf28-4805-4f06-80ef-466c3873d6a5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.975877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764b450-b82a-4548-8683-c7178becf048 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.012683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64309cd6-b022-4902-a901-197e19bb146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.013297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64309cd6-b022-4902-a901-197e19bb146c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.013575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64309cd6-b022-4902-a901-197e19bb146c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.013846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64309cd6-b022-4902-a901-197e19bb146c None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.014817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64309cd6-b022-4902-a901-197e19bb146c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:43.015023 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64309cd6-b022-4902-a901-197e19bb146c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.016393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64309cd6-b022-4902-a901-197e19bb146c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.028700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 439/850] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:43.040552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64309cd6-b022-4902-a901-197e19bb146c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.071331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ccf28-4805-4f06-80ef-466c3873d6a5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.114664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073ced7-ff17-41ff-b81b-aeb64dd935f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.114664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ced7-ff17-41ff-b81b-aeb64dd935f9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.114664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ced7-ff17-41ff-b81b-aeb64dd935f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.115031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ced7-ff17-41ff-b81b-aeb64dd935f9 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.115777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073ced7-ff17-41ff-b81b-aeb64dd935f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:43.116103 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073ced7-ff17-41ff-b81b-aeb64dd935f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.118339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073ced7-ff17-41ff-b81b-aeb64dd935f9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.140921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 412/851] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:43.148138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073ced7-ff17-41ff-b81b-aeb64dd935f9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.169203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64309cd6-b022-4902-a901-197e19bb146c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.199456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.206924 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.214088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c594-7794-48b9-9bbb-d6ad9283000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.214916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c594-7794-48b9-9bbb-d6ad9283000b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.215517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c594-7794-48b9-9bbb-d6ad9283000b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.216498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c594-7794-48b9-9bbb-d6ad9283000b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.227021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738c594-7794-48b9-9bbb-d6ad9283000b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.228657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738c594-7794-48b9-9bbb-d6ad9283000b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7738c594-7794-48b9-9bbb-d6ad9283000b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:43.245255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:43.250604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:43.251969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:43.251969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:43.251969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:43.251969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:43.251969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:43.251969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:43.251969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:43.251969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:43.251969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:43.251969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:43.251969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 440/852] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:43.252814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c594-7794-48b9-9bbb-d6ad9283000b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.276746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073ced7-ff17-41ff-b81b-aeb64dd935f9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.324761 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fe3fc-4f75-4001-81ef-31567574e59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.326013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe3fc-4f75-4001-81ef-31567574e59f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.326754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe3fc-4f75-4001-81ef-31567574e59f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.327272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe3fc-4f75-4001-81ef-31567574e59f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.384938 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c594-7794-48b9-9bbb-d6ad9283000b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.420917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831920fa-4d09-402f-ae58-3db49d0f481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.421583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831920fa-4d09-402f-ae58-3db49d0f481d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.421876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831920fa-4d09-402f-ae58-3db49d0f481d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.422155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831920fa-4d09-402f-ae58-3db49d0f481d None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.422985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831920fa-4d09-402f-ae58-3db49d0f481d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:43.423328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831920fa-4d09-402f-ae58-3db49d0f481d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.424781 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831920fa-4d09-402f-ae58-3db49d0f481d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.428800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fe3fc-4f75-4001-81ef-31567574e59f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.431284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fe3fc-4f75-4001-81ef-31567574e59f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.449974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 441/853] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:43.450792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831920fa-4d09-402f-ae58-3db49d0f481d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.484147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.511411 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.544113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 413/854] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:43.550717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fe3fc-4f75-4001-81ef-31567574e59f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.585561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831920fa-4d09-402f-ae58-3db49d0f481d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.636053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fdba1-fcad-4a28-8c3e-7ae665c0a28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.636053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fdba1-fcad-4a28-8c3e-7ae665c0a28a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.636053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fdba1-fcad-4a28-8c3e-7ae665c0a28a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.636384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fdba1-fcad-4a28-8c3e-7ae665c0a28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.677867 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fe3fc-4f75-4001-81ef-31567574e59f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.716556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151551b0-bd75-4c81-a292-a4e64745e4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.717496 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151551b0-bd75-4c81-a292-a4e64745e4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.717774 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151551b0-bd75-4c81-a292-a4e64745e4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.718116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151551b0-bd75-4c81-a292-a4e64745e4f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.732303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fdba1-fcad-4a28-8c3e-7ae665c0a28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.732663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151551b0-bd75-4c81-a292-a4e64745e4f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.733782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fdba1-fcad-4a28-8c3e-7ae665c0a28a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.734094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151551b0-bd75-4c81-a292-a4e64745e4f1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.737165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-151551b0-bd75-4c81-a292-a4e64745e4f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:43.750681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:43.753890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:43.754813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:43.754813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:43.754813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:43.754813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 414/855] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:43.757344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151551b0-bd75-4c81-a292-a4e64745e4f1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.787805 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.862101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 442/856] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:43.869868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fdba1-fcad-4a28-8c3e-7ae665c0a28a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.879345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151551b0-bd75-4c81-a292-a4e64745e4f1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.916698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6a57e-2efb-4e85-ac5a-2e4ece5f644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.917543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6a57e-2efb-4e85-ac5a-2e4ece5f644e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.917981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6a57e-2efb-4e85-ac5a-2e4ece5f644e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.918258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6a57e-2efb-4e85-ac5a-2e4ece5f644e None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.918911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6a57e-2efb-4e85-ac5a-2e4ece5f644e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:43.919257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6a57e-2efb-4e85-ac5a-2e4ece5f644e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.920634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6a57e-2efb-4e85-ac5a-2e4ece5f644e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.933534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 415/857] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:43.933534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063631-b152-437a-b2e6-895b8ef07a08 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.933534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063631-b152-437a-b2e6-895b8ef07a08 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.933534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063631-b152-437a-b2e6-895b8ef07a08 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.933534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 416/858] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:43.940753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89063631-b152-437a-b2e6-895b8ef07a08 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.983162 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fdba1-fcad-4a28-8c3e-7ae665c0a28a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.014314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.022017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d103a-53c6-4a85-84ce-cf60aaf5844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.022663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d103a-53c6-4a85-84ce-cf60aaf5844c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.022942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d103a-53c6-4a85-84ce-cf60aaf5844c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.030822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d103a-53c6-4a85-84ce-cf60aaf5844c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.033219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.035338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d103a-53c6-4a85-84ce-cf60aaf5844c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.037063 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d103a-53c6-4a85-84ce-cf60aaf5844c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-485d103a-53c6-4a85-84ce-cf60aaf5844c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:44.052364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:44.053711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:44.054680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:44.054680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:44.054680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:44.054680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 443/859] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:44.054680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be146c-c067-4f14-ae5b-ab9f07f53488 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.055705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be146c-c067-4f14-ae5b-ab9f07f53488 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.055908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be146c-c067-4f14-ae5b-ab9f07f53488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.069416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89063631-b152-437a-b2e6-895b8ef07a08 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.075452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b0be146c-c067-4f14-ae5b-ab9f07f53488 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:44.077441 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b0be146c-c067-4f14-ae5b-ab9f07f53488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:44.105294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec51dca-f232-4ee3-8d1b-851d12843592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.106054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec51dca-f232-4ee3-8d1b-851d12843592 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.106397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec51dca-f232-4ee3-8d1b-851d12843592 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.106741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec51dca-f232-4ee3-8d1b-851d12843592 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.113847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec51dca-f232-4ee3-8d1b-851d12843592 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.115338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec51dca-f232-4ee3-8d1b-851d12843592 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-fec51dca-f232-4ee3-8d1b-851d12843592 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:44.127251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:44.128376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:44.134340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:44.134340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:44.134340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:44.134340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:44.134340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:44.134340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:44.134340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:44.134340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:44.134340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 417/860] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:44.134340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec51dca-f232-4ee3-8d1b-851d12843592 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.165587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 444/861] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:44.171398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be146c-c067-4f14-ae5b-ab9f07f53488 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.251808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec51dca-f232-4ee3-8d1b-851d12843592 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.269311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.296352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232dd38-cdf4-463a-a207-0c11898b258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.297287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232dd38-cdf4-463a-a207-0c11898b258c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.298009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232dd38-cdf4-463a-a207-0c11898b258c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.298439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232dd38-cdf4-463a-a207-0c11898b258c None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.299970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232dd38-cdf4-463a-a207-0c11898b258c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:44.300453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232dd38-cdf4-463a-a207-0c11898b258c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.301949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be146c-c067-4f14-ae5b-ab9f07f53488 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.302149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232dd38-cdf4-463a-a207-0c11898b258c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.320762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 418/862] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:44.326266 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232dd38-cdf4-463a-a207-0c11898b258c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.330454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.339809 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba63bde-2db2-429d-baa8-478d6bba7aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.340504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63bde-2db2-429d-baa8-478d6bba7aba None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.340865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63bde-2db2-429d-baa8-478d6bba7aba None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.341151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63bde-2db2-429d-baa8-478d6bba7aba None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.341713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba63bde-2db2-429d-baa8-478d6bba7aba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:44.342020 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba63bde-2db2-429d-baa8-478d6bba7aba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.343520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba63bde-2db2-429d-baa8-478d6bba7aba None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.361426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 445/863] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:44.362524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba63bde-2db2-429d-baa8-478d6bba7aba None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.448025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232dd38-cdf4-463a-a207-0c11898b258c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.469581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba63bde-2db2-429d-baa8-478d6bba7aba None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.488202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a3033-54eb-4c82-a534-af733a419b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.488835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a3033-54eb-4c82-a534-af733a419b93 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.489115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a3033-54eb-4c82-a534-af733a419b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.489389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a3033-54eb-4c82-a534-af733a419b93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.496203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a3033-54eb-4c82-a534-af733a419b93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.497645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a3033-54eb-4c82-a534-af733a419b93 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.504215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48f6c-161f-46b6-9b93-a8ee92129b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.504819 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48f6c-161f-46b6-9b93-a8ee92129b0d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.505096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48f6c-161f-46b6-9b93-a8ee92129b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.505364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48f6c-161f-46b6-9b93-a8ee92129b0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.506092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a48f6c-161f-46b6-9b93-a8ee92129b0d None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=d4052d31496a46948211cd4b7d38808b) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:44.506398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a48f6c-161f-46b6-9b93-a8ee92129b0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.508361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a48f6c-161f-46b6-9b93-a8ee92129b0d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-271a3033-54eb-4c82-a534-af733a419b93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:44.509216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:44.510250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:44.511284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:44.511284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:44.511284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:44.511284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:44.511284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:44.511284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:44.511284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:44.511284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:44.514174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 446/864] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/role_assignments?user.id=d4052d31496a46948211cd4b7d38808b&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:44.515172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 419/865] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:44.515363 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48f6c-161f-46b6-9b93-a8ee92129b0d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.516575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a375f4b-0b96-4984-a108-2891c5bb82a8 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.516575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a375f4b-0b96-4984-a108-2891c5bb82a8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.517198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a375f4b-0b96-4984-a108-2891c5bb82a8 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.518545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 420/866] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:44.519283 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a375f4b-0b96-4984-a108-2891c5bb82a8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.564358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.579431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.639396 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a375f4b-0b96-4984-a108-2891c5bb82a8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.640913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48f6c-161f-46b6-9b93-a8ee92129b0d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.679037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e78507-f740-4d88-b52c-d57101d02c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.680458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e78507-f740-4d88-b52c-d57101d02c83 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.680458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e78507-f740-4d88-b52c-d57101d02c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.680630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d93d99-4311-412c-9ed1-4aa250b0adcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.680742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e78507-f740-4d88-b52c-d57101d02c83 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.680816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d93d99-4311-412c-9ed1-4aa250b0adcc None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.680884 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e78507-f740-4d88-b52c-d57101d02c83 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.680952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d93d99-4311-412c-9ed1-4aa250b0adcc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.681206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d93d99-4311-412c-9ed1-4aa250b0adcc None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.681859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d93d99-4311-412c-9ed1-4aa250b0adcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:44.682166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d93d99-4311-412c-9ed1-4aa250b0adcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.682325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e78507-f740-4d88-b52c-d57101d02c83 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.683656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d93d99-4311-412c-9ed1-4aa250b0adcc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c3e78507-f740-4d88-b52c-d57101d02c83 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:44.691367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:44.692321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:44.693234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 447/867] 10.222.0.88 () {56 vars in 1132 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:44.694025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b338cc0-1ae5-43f1-a18b-39b3ce1d07c1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.694025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b338cc0-1ae5-43f1-a18b-39b3ce1d07c1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.694153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b338cc0-1ae5-43f1-a18b-39b3ce1d07c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.699501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 421/868] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:44.701061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d93d99-4311-412c-9ed1-4aa250b0adcc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.715430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0b338cc0-1ae5-43f1-a18b-39b3ce1d07c1 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:44.716665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b338cc0-1ae5-43f1-a18b-39b3ce1d07c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:44.791571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 448/869] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:44.792439 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b338cc0-1ae5-43f1-a18b-39b3ce1d07c1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.813338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.821568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d93d99-4311-412c-9ed1-4aa250b0adcc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.835920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.859850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec6abd-17b5-4b79-ac6e-ca9c8ddc68a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.860966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6abd-17b5-4b79-ac6e-ca9c8ddc68a0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.861469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6abd-17b5-4b79-ac6e-ca9c8ddc68a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.861933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6abd-17b5-4b79-ac6e-ca9c8ddc68a0 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.862720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec6abd-17b5-4b79-ac6e-ca9c8ddc68a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:44.863217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec6abd-17b5-4b79-ac6e-ca9c8ddc68a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.864749 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec6abd-17b5-4b79-ac6e-ca9c8ddc68a0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.870708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 422/870] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:44.875995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec6abd-17b5-4b79-ac6e-ca9c8ddc68a0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.903785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b338cc0-1ae5-43f1-a18b-39b3ce1d07c1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.940022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5134c7-b92e-4956-acc9-ae11fc407836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.940592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5134c7-b92e-4956-acc9-ae11fc407836 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.940859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5134c7-b92e-4956-acc9-ae11fc407836 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.941133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5134c7-b92e-4956-acc9-ae11fc407836 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.941867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5134c7-b92e-4956-acc9-ae11fc407836 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=d33c67fc513e49df9f6792475ff2d20e) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:44.942238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5134c7-b92e-4956-acc9-ae11fc407836 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.943765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5134c7-b92e-4956-acc9-ae11fc407836 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.955149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 449/871] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/role_assignments?user.id=d33c67fc513e49df9f6792475ff2d20e&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:44.996909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec6abd-17b5-4b79-ac6e-ca9c8ddc68a0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:45.035760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd542b-e14a-488e-bb7c-6c5db4711579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:45.036389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd542b-e14a-488e-bb7c-6c5db4711579 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:45.036672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd542b-e14a-488e-bb7c-6c5db4711579 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:45.036946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd542b-e14a-488e-bb7c-6c5db4711579 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:45.037602 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd542b-e14a-488e-bb7c-6c5db4711579 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:45.037910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd542b-e14a-488e-bb7c-6c5db4711579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:45.039401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd542b-e14a-488e-bb7c-6c5db4711579 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:45.045124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 423/872] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:45.074982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5134c7-b92e-4956-acc9-ae11fc407836 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:45.190975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5134c7-b92e-4956-acc9-ae11fc407836 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:45.196102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:45.237325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ca525-c594-4a3e-8fdb-87e3d22f76f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:45.237864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca525-c594-4a3e-8fdb-87e3d22f76f6 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:45.238145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca525-c594-4a3e-8fdb-87e3d22f76f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:45.238419 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca525-c594-4a3e-8fdb-87e3d22f76f6 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:45.239111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ca525-c594-4a3e-8fdb-87e3d22f76f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:45.240501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ca525-c594-4a3e-8fdb-87e3d22f76f6 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:45.309292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 450/873] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:45 2022] POST /identity/v3/services => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:46.513260 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779b5fb-9f11-4c9a-bcb4-f592606737d7 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.513787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779b5fb-9f11-4c9a-bcb4-f592606737d7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.513787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779b5fb-9f11-4c9a-bcb4-f592606737d7 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.515414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 424/874] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:46.520846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b41fa-c620-45f0-bea8-412650c2c8e7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.521275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b41fa-c620-45f0-bea8-412650c2c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.521449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b41fa-c620-45f0-bea8-412650c2c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.541443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-180b41fa-c620-45f0-bea8-412650c2c8e7 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:46.542754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-180b41fa-c620-45f0-bea8-412650c2c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:46.620233 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 451/875] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:46.884921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779b5fb-9f11-4c9a-bcb4-f592606737d7 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:46.911391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:46.991397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779b5fb-9f11-4c9a-bcb4-f592606737d7 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.017700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e57094-c11f-4142-a926-a8c33b76964d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.018311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e57094-c11f-4142-a926-a8c33b76964d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.018792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e57094-c11f-4142-a926-a8c33b76964d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.020652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 452/876] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:47.021683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bded31-8aeb-4460-a5aa-e9a46c320056 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.021977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bded31-8aeb-4460-a5aa-e9a46c320056 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.022234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bded31-8aeb-4460-a5aa-e9a46c320056 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.027388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 453/877] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:47.028515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c7aac-99c9-4155-bf16-abf709d70fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.028515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c7aac-99c9-4155-bf16-abf709d70fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.028730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34311f0-010c-496a-8739-649d03722ad9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.028803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c7aac-99c9-4155-bf16-abf709d70fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.028871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34311f0-010c-496a-8739-649d03722ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.028939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c7aac-99c9-4155-bf16-abf709d70fe1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.029016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34311f0-010c-496a-8739-649d03722ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.031084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c7aac-99c9-4155-bf16-abf709d70fe1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.031084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c7aac-99c9-4155-bf16-abf709d70fe1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-be7c7aac-99c9-4155-bf16-abf709d70fe1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:47.040466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:47.041483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:47.042326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 425/878] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:47.043236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f93180-22bd-4e71-b6e8-0ab9edf70c7a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.043305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f93180-22bd-4e71-b6e8-0ab9edf70c7a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.044039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f93180-22bd-4e71-b6e8-0ab9edf70c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.050719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f34311f0-010c-496a-8739-649d03722ad9 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:47.052782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f34311f0-010c-496a-8739-649d03722ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:47.061256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-51f93180-22bd-4e71-b6e8-0ab9edf70c7a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:47.062440 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-51f93180-22bd-4e71-b6e8-0ab9edf70c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:47.139120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 454/879] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:47.139120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34311f0-010c-496a-8739-649d03722ad9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.143192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 426/880] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:47.163507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.240047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34311f0-010c-496a-8739-649d03722ad9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.277036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb60c1-4ff0-4d7b-9c28-41e64a426677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.277652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb60c1-4ff0-4d7b-9c28-41e64a426677 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.277935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb60c1-4ff0-4d7b-9c28-41e64a426677 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.278211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb60c1-4ff0-4d7b-9c28-41e64a426677 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.278848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb60c1-4ff0-4d7b-9c28-41e64a426677 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:47.279186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb60c1-4ff0-4d7b-9c28-41e64a426677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.280577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb60c1-4ff0-4d7b-9c28-41e64a426677 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.285594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 455/881] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:47.292160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f93180-22bd-4e71-b6e8-0ab9edf70c7a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.312493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.325470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1956c1-38fa-4b32-818b-86b0278eb45b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.325748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1956c1-38fa-4b32-818b-86b0278eb45b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.326023 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1956c1-38fa-4b32-818b-86b0278eb45b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.328591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 456/882] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:47.332627 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1894-2695-4c79-85f9-75cf33a943f8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.332979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1894-2695-4c79-85f9-75cf33a943f8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.333313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1894-2695-4c79-85f9-75cf33a943f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.358057 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-895f1894-2695-4c79-85f9-75cf33a943f8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:47.358643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-895f1894-2695-4c79-85f9-75cf33a943f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:47.410604 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f93180-22bd-4e71-b6e8-0ab9edf70c7a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.439766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 457/883] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:47.440631 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1894-2695-4c79-85f9-75cf33a943f8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.452029 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe113-c64f-4b8b-b8a2-d03f55907cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.452757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe113-c64f-4b8b-b8a2-d03f55907cac None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.453045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe113-c64f-4b8b-b8a2-d03f55907cac None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.453321 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe113-c64f-4b8b-b8a2-d03f55907cac None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.453961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe113-c64f-4b8b-b8a2-d03f55907cac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:47.454266 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe113-c64f-4b8b-b8a2-d03f55907cac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.455794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe113-c64f-4b8b-b8a2-d03f55907cac None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.456307 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.467712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 427/884] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:47.467712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe113-c64f-4b8b-b8a2-d03f55907cac None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.573250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.582132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1894-2695-4c79-85f9-75cf33a943f8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.594600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe113-c64f-4b8b-b8a2-d03f55907cac None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.633568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04d09b-cf46-4d46-a6ec-193263457999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.634187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04d09b-cf46-4d46-a6ec-193263457999 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.634473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04d09b-cf46-4d46-a6ec-193263457999 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.634748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04d09b-cf46-4d46-a6ec-193263457999 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.635690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04d09b-cf46-4d46-a6ec-193263457999 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.636825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04d09b-cf46-4d46-a6ec-193263457999 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.644292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd284-f360-4f55-89f0-75623410ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.644964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd284-f360-4f55-89f0-75623410ffa2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.645245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd284-f360-4f55-89f0-75623410ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.645521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd284-f360-4f55-89f0-75623410ffa2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.656401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbd284-f360-4f55-89f0-75623410ffa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c9fbd284-f360-4f55-89f0-75623410ffa2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:47.664651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:47.665588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:47.666506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 428/885] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:47.668687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd284-f360-4f55-89f0-75623410ffa2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.756362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 458/886] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:47 2022] POST /identity/v3/services => generated 269 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:47.757581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04d09b-cf46-4d46-a6ec-193263457999 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.776288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd284-f360-4f55-89f0-75623410ffa2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.826041 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95ed17-bd12-482c-b9bb-05c4336f8b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.826830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95ed17-bd12-482c-b9bb-05c4336f8b03 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.827238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95ed17-bd12-482c-b9bb-05c4336f8b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.827591 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95ed17-bd12-482c-b9bb-05c4336f8b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.828353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95ed17-bd12-482c-b9bb-05c4336f8b03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:47.828749 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95ed17-bd12-482c-b9bb-05c4336f8b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.830307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95ed17-bd12-482c-b9bb-05c4336f8b03 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.837593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.842792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 429/887] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:47.847766 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95ed17-bd12-482c-b9bb-05c4336f8b03 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.877076 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.916216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04d09b-cf46-4d46-a6ec-193263457999 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.959503 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d0a37-815b-423d-ae29-b803acd72a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.960152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d0a37-815b-423d-ae29-b803acd72a34 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.960434 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d0a37-815b-423d-ae29-b803acd72a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.961256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d0a37-815b-423d-ae29-b803acd72a34 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.961854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d0a37-815b-423d-ae29-b803acd72a34 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.963281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d0a37-815b-423d-ae29-b803acd72a34 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-297d0a37-815b-423d-ae29-b803acd72a34 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:47.972278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:47.973386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:47.974234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:47.974988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 459/888] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:47.977314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95ed17-bd12-482c-b9bb-05c4336f8b03 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.983360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d0a37-815b-423d-ae29-b803acd72a34 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.013777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137e45-49f0-4f61-a76e-6e7b1f971a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.014419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137e45-49f0-4f61-a76e-6e7b1f971a6c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.014783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137e45-49f0-4f61-a76e-6e7b1f971a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.015085 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66137e45-49f0-4f61-a76e-6e7b1f971a6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.027076 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66137e45-49f0-4f61-a76e-6e7b1f971a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.031869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66137e45-49f0-4f61-a76e-6e7b1f971a6c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-66137e45-49f0-4f61-a76e-6e7b1f971a6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:48.048201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:48.049476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:48.050409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:48.050409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:48.050409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:48.052599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 430/889] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:48.057914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137e45-49f0-4f61-a76e-6e7b1f971a6c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.102988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d0a37-815b-423d-ae29-b803acd72a34 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.133558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.140341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a89b-d912-4e7d-a5f1-4e71f745b6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.141101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a89b-d912-4e7d-a5f1-4e71f745b6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.141382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a89b-d912-4e7d-a5f1-4e71f745b6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.141659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a89b-d912-4e7d-a5f1-4e71f745b6e3 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.142360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98a89b-d912-4e7d-a5f1-4e71f745b6e3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:48.142671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98a89b-d912-4e7d-a5f1-4e71f745b6e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.144107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98a89b-d912-4e7d-a5f1-4e71f745b6e3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.150333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 460/890] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:48.156046 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a89b-d912-4e7d-a5f1-4e71f745b6e3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.159289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.199397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66137e45-49f0-4f61-a76e-6e7b1f971a6c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.245748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf1641-6956-471e-ae6c-412851a8edfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.246777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf1641-6956-471e-ae6c-412851a8edfb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.247090 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf1641-6956-471e-ae6c-412851a8edfb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.247378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf1641-6956-471e-ae6c-412851a8edfb None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.248044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf1641-6956-471e-ae6c-412851a8edfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:48.248362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf1641-6956-471e-ae6c-412851a8edfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.250085 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf1641-6956-471e-ae6c-412851a8edfb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.267428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 431/891] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:48.271405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a89b-d912-4e7d-a5f1-4e71f745b6e3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.276030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf1641-6956-471e-ae6c-412851a8edfb None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.314677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46136b26-047f-494b-a321-f39164a4cf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.315432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136b26-047f-494b-a321-f39164a4cf41 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.315782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136b26-047f-494b-a321-f39164a4cf41 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.316129 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136b26-047f-494b-a321-f39164a4cf41 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.316945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46136b26-047f-494b-a321-f39164a4cf41 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:48.317423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46136b26-047f-494b-a321-f39164a4cf41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.318885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46136b26-047f-494b-a321-f39164a4cf41 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.325199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 461/892] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:48.331150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46136b26-047f-494b-a321-f39164a4cf41 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.412076 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf1641-6956-471e-ae6c-412851a8edfb None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.416839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.430560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.454007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01107d4-1612-4617-9548-5777e54f1f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.454974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01107d4-1612-4617-9548-5777e54f1f9b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.455495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01107d4-1612-4617-9548-5777e54f1f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.455970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01107d4-1612-4617-9548-5777e54f1f9b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.460449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46136b26-047f-494b-a321-f39164a4cf41 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.465241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01107d4-1612-4617-9548-5777e54f1f9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.467176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01107d4-1612-4617-9548-5777e54f1f9b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f01107d4-1612-4617-9548-5777e54f1f9b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:48.480811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:48.481837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:48.482811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:48.482811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:48.482811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:48.482811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:48.482811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:48.482811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:48.482811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:48.482811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:48.482811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:48.482811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:48.493192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 432/893] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:48.494557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01107d4-1612-4617-9548-5777e54f1f9b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.507072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4384e39-8c23-49df-9239-12c3c5c4e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.509092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4384e39-8c23-49df-9239-12c3c5c4e6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.509453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4384e39-8c23-49df-9239-12c3c5c4e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.509878 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4384e39-8c23-49df-9239-12c3c5c4e6e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.511012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4384e39-8c23-49df-9239-12c3c5c4e6e1 None admin] RBAC: Adding query filter params (interface=public, service_id=df56ddd9e62a486c9488c2f6c22c8a25, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:48.511692 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4384e39-8c23-49df-9239-12c3c5c4e6e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.514936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4384e39-8c23-49df-9239-12c3c5c4e6e1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.526297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 462/894] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/endpoints?service_id=df56ddd9e62a486c9488c2f6c22c8a25&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:48.534753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4384e39-8c23-49df-9239-12c3c5c4e6e1 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.626811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01107d4-1612-4617-9548-5777e54f1f9b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.646339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4384e39-8c23-49df-9239-12c3c5c4e6e1 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.670696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fed71e-3a54-4425-bc4e-fd851dcb80c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.671821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fed71e-3a54-4425-bc4e-fd851dcb80c1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.672305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fed71e-3a54-4425-bc4e-fd851dcb80c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.672779 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fed71e-3a54-4425-bc4e-fd851dcb80c1 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.673834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fed71e-3a54-4425-bc4e-fd851dcb80c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:48.674598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fed71e-3a54-4425-bc4e-fd851dcb80c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.676390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fed71e-3a54-4425-bc4e-fd851dcb80c1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.676913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.683583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f8a88-3851-41f5-aa63-e242f43668e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.684198 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8a88-3851-41f5-aa63-e242f43668e0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.684570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8a88-3851-41f5-aa63-e242f43668e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.684854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8a88-3851-41f5-aa63-e242f43668e0 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.685464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f8a88-3851-41f5-aa63-e242f43668e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.686840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f8a88-3851-41f5-aa63-e242f43668e0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.699160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 433/896] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:48.699354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 463/896] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:27:48.711432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f8a88-3851-41f5-aa63-e242f43668e0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.827351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f8a88-3851-41f5-aa63-e242f43668e0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.865362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47df06c-4a7c-4086-985a-14b775ac9533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.865979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df06c-4a7c-4086-985a-14b775ac9533 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.866261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df06c-4a7c-4086-985a-14b775ac9533 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.866534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df06c-4a7c-4086-985a-14b775ac9533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.933136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.940897 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47df06c-4a7c-4086-985a-14b775ac9533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.949131 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47df06c-4a7c-4086-985a-14b775ac9533 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.057641 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 464/897] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:49.064593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fed71e-3a54-4425-bc4e-fd851dcb80c1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:49.102845 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:49.174600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fed71e-3a54-4425-bc4e-fd851dcb80c1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:49.212202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b860781-d10e-4cad-b22d-2cb65bde2f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:49.212844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b860781-d10e-4cad-b22d-2cb65bde2f58 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.213130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b860781-d10e-4cad-b22d-2cb65bde2f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.213407 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b860781-d10e-4cad-b22d-2cb65bde2f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.223796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b860781-d10e-4cad-b22d-2cb65bde2f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:49.225331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b860781-d10e-4cad-b22d-2cb65bde2f58 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-5b860781-d10e-4cad-b22d-2cb65bde2f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:49.240342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:49.241443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:49.243244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:49.243244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:49.243244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:49.243244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 434/898] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:49.248170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47df06c-4a7c-4086-985a-14b775ac9533 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:49.345228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:49.351607 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47df06c-4a7c-4086-985a-14b775ac9533 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:49.389307 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2305c4-532f-4313-8955-0d61e6c2a054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:49.389926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2305c4-532f-4313-8955-0d61e6c2a054 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.390208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2305c4-532f-4313-8955-0d61e6c2a054 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.390488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2305c4-532f-4313-8955-0d61e6c2a054 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.391182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2305c4-532f-4313-8955-0d61e6c2a054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:49.391494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2305c4-532f-4313-8955-0d61e6c2a054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:49.392883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2305c4-532f-4313-8955-0d61e6c2a054 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.405886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 465/899] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:49.411548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b860781-d10e-4cad-b22d-2cb65bde2f58 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:49.495922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:49.514159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b860781-d10e-4cad-b22d-2cb65bde2f58 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:49.550349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7159fc-f1b4-495c-a666-964b1af63a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:49.550986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7159fc-f1b4-495c-a666-964b1af63a89 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.551300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7159fc-f1b4-495c-a666-964b1af63a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.551577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7159fc-f1b4-495c-a666-964b1af63a89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.558902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7159fc-f1b4-495c-a666-964b1af63a89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:49.561126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7159fc-f1b4-495c-a666-964b1af63a89 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-6c7159fc-f1b4-495c-a666-964b1af63a89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:49.573464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:49.574430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:49.575783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:49.575783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:49.575783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:49.575783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:49.575783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:49.575783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:49.575783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:49.575783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:49.575783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 435/900] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:49.580885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dc83b-23c5-4280-8346-e08f281b5093 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.581175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dc83b-23c5-4280-8346-e08f281b5093 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.581454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dc83b-23c5-4280-8346-e08f281b5093 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.582900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 466/901] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:49.584070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7159fc-f1b4-495c-a666-964b1af63a89 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:49.589159 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0d51-c95e-433f-b473-56de528846e4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.589444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0d51-c95e-433f-b473-56de528846e4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.589713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0d51-c95e-433f-b473-56de528846e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.611660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ddcb0d51-c95e-433f-b473-56de528846e4 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:49.613407 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ddcb0d51-c95e-433f-b473-56de528846e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:49.696748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7159fc-f1b4-495c-a666-964b1af63a89 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:49.711218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 467/902] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:49.740929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15ffa9-8de8-4e24-b468-51f506ad6c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:49.741588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15ffa9-8de8-4e24-b468-51f506ad6c69 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.741922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15ffa9-8de8-4e24-b468-51f506ad6c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.742202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15ffa9-8de8-4e24-b468-51f506ad6c69 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.742916 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15ffa9-8de8-4e24-b468-51f506ad6c69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:49.743252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15ffa9-8de8-4e24-b468-51f506ad6c69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:49.744691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15ffa9-8de8-4e24-b468-51f506ad6c69 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.758074 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 436/903] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:49.764091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb0d51-c95e-433f-b473-56de528846e4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:49.854012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:49.871439 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb0d51-c95e-433f-b473-56de528846e4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:49.904368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c9956-27d2-4176-8686-2feb1061b110 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.904730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c9956-27d2-4176-8686-2feb1061b110 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.904923 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c9956-27d2-4176-8686-2feb1061b110 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.906290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 437/904] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:49.912623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76022f-9e22-4291-a818-67368704faa9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.912913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76022f-9e22-4291-a818-67368704faa9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.913533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76022f-9e22-4291-a818-67368704faa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.918268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191cbb3-7d24-46f8-8477-a6bcdfbd0e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:49.918995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191cbb3-7d24-46f8-8477-a6bcdfbd0e4d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.919315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191cbb3-7d24-46f8-8477-a6bcdfbd0e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.919590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191cbb3-7d24-46f8-8477-a6bcdfbd0e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.920328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191cbb3-7d24-46f8-8477-a6bcdfbd0e4d None admin] RBAC: Adding query filter params (role.id=984fb3415f2747f89ce2d5bcd6089515, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=d33c67fc513e49df9f6792475ff2d20e) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:49.920452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:49.920987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191cbb3-7d24-46f8-8477-a6bcdfbd0e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:49.923149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191cbb3-7d24-46f8-8477-a6bcdfbd0e4d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.929696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 468/905] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/role_assignments?user.id=d33c67fc513e49df9f6792475ff2d20e&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=984fb3415f2747f89ce2d5bcd6089515 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:49.936314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3b76022f-9e22-4291-a818-67368704faa9 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:49.938061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3b76022f-9e22-4291-a818-67368704faa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:50.017927 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 438/906] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:50.035590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191cbb3-7d24-46f8-8477-a6bcdfbd0e4d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.145888 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191cbb3-7d24-46f8-8477-a6bcdfbd0e4d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.182416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5627da-cba2-481d-b2e4-49baae64b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.183033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5627da-cba2-481d-b2e4-49baae64b342 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.183345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5627da-cba2-481d-b2e4-49baae64b342 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.183620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5627da-cba2-481d-b2e4-49baae64b342 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.184281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5627da-cba2-481d-b2e4-49baae64b342 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.185663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5627da-cba2-481d-b2e4-49baae64b342 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.252178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 469/907] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:50 2022] POST /identity/v3/services => generated 241 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:50.292985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76022f-9e22-4291-a818-67368704faa9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.405585 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76022f-9e22-4291-a818-67368704faa9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.442780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.448955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1c849-56df-4c50-949d-d77b188b97f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.449602 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1c849-56df-4c50-949d-d77b188b97f9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.449879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1c849-56df-4c50-949d-d77b188b97f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.450152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1c849-56df-4c50-949d-d77b188b97f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.450740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1c849-56df-4c50-949d-d77b188b97f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.452161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1c849-56df-4c50-949d-d77b188b97f9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-03e1c849-56df-4c50-949d-d77b188b97f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:50.461700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:50.462709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:50.463741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 439/908] 10.222.0.88 () {56 vars in 1132 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:50.472178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5627da-cba2-481d-b2e4-49baae64b342 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.484304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.601648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5627da-cba2-481d-b2e4-49baae64b342 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.639994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8376955-2047-4edc-8dd2-bb86bfd63d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.640619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8376955-2047-4edc-8dd2-bb86bfd63d9f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.640956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8376955-2047-4edc-8dd2-bb86bfd63d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.641242 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8376955-2047-4edc-8dd2-bb86bfd63d9f None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.641898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8376955-2047-4edc-8dd2-bb86bfd63d9f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:50.642208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8376955-2047-4edc-8dd2-bb86bfd63d9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.643641 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8376955-2047-4edc-8dd2-bb86bfd63d9f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.649370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 470/909] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:50.655121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1c849-56df-4c50-949d-d77b188b97f9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.768953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1c849-56df-4c50-949d-d77b188b97f9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.775312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9894cc-41b0-40fb-8086-36f5a684c084 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.776165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9894cc-41b0-40fb-8086-36f5a684c084 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.776721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9894cc-41b0-40fb-8086-36f5a684c084 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.778602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 471/910] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:50.783639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3b73e-6bb7-4cd6-82d9-1dd380106d14 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.783924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3b73e-6bb7-4cd6-82d9-1dd380106d14 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.784202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3b73e-6bb7-4cd6-82d9-1dd380106d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.805490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b0a3b73e-6bb7-4cd6-82d9-1dd380106d14 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:50.805736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237d036-dbba-4e71-9433-359ed76d21d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.806349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237d036-dbba-4e71-9433-359ed76d21d1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.806628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237d036-dbba-4e71-9433-359ed76d21d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.806733 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b0a3b73e-6bb7-4cd6-82d9-1dd380106d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:50.806904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237d036-dbba-4e71-9433-359ed76d21d1 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.807624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237d036-dbba-4e71-9433-359ed76d21d1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:50.807931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237d036-dbba-4e71-9433-359ed76d21d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.809305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237d036-dbba-4e71-9433-359ed76d21d1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.814782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 440/911] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:50.820742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237d036-dbba-4e71-9433-359ed76d21d1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.904292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.915199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 472/912] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:50.961991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237d036-dbba-4e71-9433-359ed76d21d1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:51.000063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4148075-88e8-4ae5-aada-bef1aa6a2348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:51.000992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148075-88e8-4ae5-aada-bef1aa6a2348 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:51.001541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148075-88e8-4ae5-aada-bef1aa6a2348 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:51.002017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148075-88e8-4ae5-aada-bef1aa6a2348 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:51.002931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4148075-88e8-4ae5-aada-bef1aa6a2348 None admin] RBAC: Adding query filter params (interface=public, service_id=0750bb57c4d5489f893de6a51f297830, region_id=RegionOne) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:51.003455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4148075-88e8-4ae5-aada-bef1aa6a2348 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:51.005083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4148075-88e8-4ae5-aada-bef1aa6a2348 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:51.011621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 441/913] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/endpoints?service_id=0750bb57c4d5489f893de6a51f297830&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:51.017507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3b73e-6bb7-4cd6-82d9-1dd380106d14 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:51.020525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:51.128439 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3b73e-6bb7-4cd6-82d9-1dd380106d14 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:51.166180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405a954-0b40-45a3-b5eb-2a67bbfbb35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:51.166778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405a954-0b40-45a3-b5eb-2a67bbfbb35a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:51.167080 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405a954-0b40-45a3-b5eb-2a67bbfbb35a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:51.167361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405a954-0b40-45a3-b5eb-2a67bbfbb35a None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:51.167976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405a954-0b40-45a3-b5eb-2a67bbfbb35a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:51.169366 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405a954-0b40-45a3-b5eb-2a67bbfbb35a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:51.176000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 473/914] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:51 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:27:51.241334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4148075-88e8-4ae5-aada-bef1aa6a2348 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:51.357300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4148075-88e8-4ae5-aada-bef1aa6a2348 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:51.378835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:51.399077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5e414-d06e-4454-a92c-98f80eda0386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:51.400344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5e414-d06e-4454-a92c-98f80eda0386 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:51.400344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5e414-d06e-4454-a92c-98f80eda0386 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:51.400344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5e414-d06e-4454-a92c-98f80eda0386 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:51.400980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5e414-d06e-4454-a92c-98f80eda0386 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:51.402557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5e414-d06e-4454-a92c-98f80eda0386 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-05d5e414-d06e-4454-a92c-98f80eda0386 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:51.418287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:51.419404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:51.420249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:51.424518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 442/915] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:51.426022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405a954-0b40-45a3-b5eb-2a67bbfbb35a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:51.496567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:51.533087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405a954-0b40-45a3-b5eb-2a67bbfbb35a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:51.569512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093f9e-5126-4306-bfd0-ee83d4463f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:51.570740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093f9e-5126-4306-bfd0-ee83d4463f57 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:51.571025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093f9e-5126-4306-bfd0-ee83d4463f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:51.571330 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093f9e-5126-4306-bfd0-ee83d4463f57 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:51.572019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e093f9e-5126-4306-bfd0-ee83d4463f57 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:51.572327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e093f9e-5126-4306-bfd0-ee83d4463f57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:51.573767 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e093f9e-5126-4306-bfd0-ee83d4463f57 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:51.583206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 474/916] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:51.584937 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5e414-d06e-4454-a92c-98f80eda0386 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:51.696236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5e414-d06e-4454-a92c-98f80eda0386 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:51.733141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9f76d-58c4-44ae-978f-81fa571c3091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:51.734141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9f76d-58c4-44ae-978f-81fa571c3091 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:51.734657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9f76d-58c4-44ae-978f-81fa571c3091 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:51.735163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9f76d-58c4-44ae-978f-81fa571c3091 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:51.736039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9f76d-58c4-44ae-978f-81fa571c3091 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:51.736560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9f76d-58c4-44ae-978f-81fa571c3091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:51.738160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9f76d-58c4-44ae-978f-81fa571c3091 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:51.744536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 443/917] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:51.752428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093f9e-5126-4306-bfd0-ee83d4463f57 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:51.860086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093f9e-5126-4306-bfd0-ee83d4463f57 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:51.890912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:51.896718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c800088-c402-43b2-a931-9eae79fb71b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:51.897399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800088-c402-43b2-a931-9eae79fb71b1 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:51.897685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800088-c402-43b2-a931-9eae79fb71b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:51.898530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800088-c402-43b2-a931-9eae79fb71b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:51.899237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800088-c402-43b2-a931-9eae79fb71b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:51.900683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800088-c402-43b2-a931-9eae79fb71b1 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:51.963114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a2019-6a42-4cf4-b138-10a80a2319ab None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:51.963676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a2019-6a42-4cf4-b138-10a80a2319ab None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:51.963676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a2019-6a42-4cf4-b138-10a80a2319ab None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:51.965005 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 444/918] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:51.970135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bed63-300c-4e7e-b84e-5e154b097acd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:51.970895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bed63-300c-4e7e-b84e-5e154b097acd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:51.970895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bed63-300c-4e7e-b84e-5e154b097acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:51.995145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-064bed63-300c-4e7e-b84e-5e154b097acd None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:51.995145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-064bed63-300c-4e7e-b84e-5e154b097acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:51.996643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 475/919] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:52.056775 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:52.089916 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 445/920] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:52.245536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b38e-489b-4ac5-a91d-351a8fe18bd3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:52.246174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b38e-489b-4ac5-a91d-351a8fe18bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:52.246681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b38e-489b-4ac5-a91d-351a8fe18bd3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:52.248580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 476/921] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:52.254286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506c1d-17ea-43c2-8717-ba28bd45f465 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:52.254589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506c1d-17ea-43c2-8717-ba28bd45f465 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:52.254873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506c1d-17ea-43c2-8717-ba28bd45f465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:52.274079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c3506c1d-17ea-43c2-8717-ba28bd45f465 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:52.275327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c3506c1d-17ea-43c2-8717-ba28bd45f465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:52.346529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 446/922] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:52.368133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006b38e-489b-4ac5-a91d-351a8fe18bd3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:52.483462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006b38e-489b-4ac5-a91d-351a8fe18bd3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:52.519109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de434bd-eb9c-4131-890c-155bfdae1494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:52.519704 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de434bd-eb9c-4131-890c-155bfdae1494 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:52.519987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de434bd-eb9c-4131-890c-155bfdae1494 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:52.520264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de434bd-eb9c-4131-890c-155bfdae1494 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:52.532216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de434bd-eb9c-4131-890c-155bfdae1494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-9de434bd-eb9c-4131-890c-155bfdae1494 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:52.536981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:52.537963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:52.539428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 477/923] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:52.544588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506c1d-17ea-43c2-8717-ba28bd45f465 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:52.622444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de434bd-eb9c-4131-890c-155bfdae1494 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:52.651209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506c1d-17ea-43c2-8717-ba28bd45f465 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:52.653770 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:52.685214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:52.688237 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4ea63-a1c6-4d2a-9098-0648a55ed74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:52.688935 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4ea63-a1c6-4d2a-9098-0648a55ed74c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:52.689213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4ea63-a1c6-4d2a-9098-0648a55ed74c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:52.689486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4ea63-a1c6-4d2a-9098-0648a55ed74c None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:52.690153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4ea63-a1c6-4d2a-9098-0648a55ed74c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:52.690453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4ea63-a1c6-4d2a-9098-0648a55ed74c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:52.691860 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4ea63-a1c6-4d2a-9098-0648a55ed74c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:52.701420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 447/924] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:52.714378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4ea63-a1c6-4d2a-9098-0648a55ed74c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:52.738698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de434bd-eb9c-4131-890c-155bfdae1494 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:52.774270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3a0ec-4a4a-4a37-813e-5f52ee7c0e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:52.774887 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a0ec-4a4a-4a37-813e-5f52ee7c0e1a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:52.775206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a0ec-4a4a-4a37-813e-5f52ee7c0e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:52.775487 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3a0ec-4a4a-4a37-813e-5f52ee7c0e1a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:52.776083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3a0ec-4a4a-4a37-813e-5f52ee7c0e1a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:52.777479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3a0ec-4a4a-4a37-813e-5f52ee7c0e1a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-ecc3a0ec-4a4a-4a37-813e-5f52ee7c0e1a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:52.786672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:52.789555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:52.791625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:52.794539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 478/925] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:52.795606 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3a0ec-4a4a-4a37-813e-5f52ee7c0e1a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:52.841627 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4ea63-a1c6-4d2a-9098-0648a55ed74c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:52.887432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e92cb8-5917-4a24-b664-357b90c116f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:52.888083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e92cb8-5917-4a24-b664-357b90c116f1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:52.888369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e92cb8-5917-4a24-b664-357b90c116f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:52.888649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e92cb8-5917-4a24-b664-357b90c116f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:52.900397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e92cb8-5917-4a24-b664-357b90c116f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:52.901880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e92cb8-5917-4a24-b664-357b90c116f1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-b0e92cb8-5917-4a24-b664-357b90c116f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:52.918306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:52.919596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:52.920494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:52.920494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:52.920494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:52.924399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 448/926] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:52.925698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e92cb8-5917-4a24-b664-357b90c116f1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:52.934208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3a0ec-4a4a-4a37-813e-5f52ee7c0e1a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:52.947154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:52.947956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:52.973258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5576f-7240-4082-b15c-467d5d5dd27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:52.973802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5576f-7240-4082-b15c-467d5d5dd27e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:52.974186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5576f-7240-4082-b15c-467d5d5dd27e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:52.974793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5576f-7240-4082-b15c-467d5d5dd27e None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:52.976461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5576f-7240-4082-b15c-467d5d5dd27e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:52.976899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5576f-7240-4082-b15c-467d5d5dd27e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:52.978779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5576f-7240-4082-b15c-467d5d5dd27e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:52.985443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 479/927] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:52.992360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5576f-7240-4082-b15c-467d5d5dd27e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.043488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e92cb8-5917-4a24-b664-357b90c116f1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.083328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da582bc-fe3e-49d6-a122-544affc101fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.084235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da582bc-fe3e-49d6-a122-544affc101fa None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.084691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da582bc-fe3e-49d6-a122-544affc101fa None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.085157 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da582bc-fe3e-49d6-a122-544affc101fa None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.085992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da582bc-fe3e-49d6-a122-544affc101fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:53.086592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da582bc-fe3e-49d6-a122-544affc101fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.088282 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da582bc-fe3e-49d6-a122-544affc101fa None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.106632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5576f-7240-4082-b15c-467d5d5dd27e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.107031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 449/928] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:53.108605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da582bc-fe3e-49d6-a122-544affc101fa None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.142465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17ca95-3b1b-4fd2-80f7-1a0b7638f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.143378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17ca95-3b1b-4fd2-80f7-1a0b7638f85b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.143653 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17ca95-3b1b-4fd2-80f7-1a0b7638f85b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.144046 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17ca95-3b1b-4fd2-80f7-1a0b7638f85b None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.144803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17ca95-3b1b-4fd2-80f7-1a0b7638f85b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:53.145242 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17ca95-3b1b-4fd2-80f7-1a0b7638f85b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.146726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17ca95-3b1b-4fd2-80f7-1a0b7638f85b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.158586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 480/929] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:53.159841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17ca95-3b1b-4fd2-80f7-1a0b7638f85b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.203843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.207439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.223892 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da582bc-fe3e-49d6-a122-544affc101fa None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.264318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590253d-d41a-4225-bb94-385b0459c583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.265484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590253d-d41a-4225-bb94-385b0459c583 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.266003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590253d-d41a-4225-bb94-385b0459c583 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.266677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590253d-d41a-4225-bb94-385b0459c583 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.268705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17ca95-3b1b-4fd2-80f7-1a0b7638f85b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.274916 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590253d-d41a-4225-bb94-385b0459c583 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.276547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590253d-d41a-4225-bb94-385b0459c583 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-8590253d-d41a-4225-bb94-385b0459c583 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:53.290049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:53.291038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:53.292052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:53.292052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:53.292052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:53.292052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:53.292052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:53.292052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:53.292052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:53.292052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:53.292052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:53.292052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:53.292052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 450/930] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:53.292667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cdaf7-01c3-4962-984e-5647fff06fa1 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.293411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cdaf7-01c3-4962-984e-5647fff06fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.293411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cdaf7-01c3-4962-984e-5647fff06fa1 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.294807 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 451/931] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:53.299370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cdaf7-01c3-4962-984e-5647fff06fa1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.315492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec43a-7f59-4f37-a680-70b324369971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.316113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec43a-7f59-4f37-a680-70b324369971 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.316399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec43a-7f59-4f37-a680-70b324369971 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.316680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec43a-7f59-4f37-a680-70b324369971 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.317400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ec43a-7f59-4f37-a680-70b324369971 None admin] RBAC: Adding query filter params (interface=public, service_id=8c1d97df318146c092019852c3c992f8, region_id=RegionOne) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:53.317714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ec43a-7f59-4f37-a680-70b324369971 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.319246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ec43a-7f59-4f37-a680-70b324369971 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.329522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 481/932] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/endpoints?service_id=8c1d97df318146c092019852c3c992f8&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:53.329522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a87a3-46a4-480a-8df2-41fcf5167931 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.329522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a87a3-46a4-480a-8df2-41fcf5167931 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.329522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a87a3-46a4-480a-8df2-41fcf5167931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.345669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-674a87a3-46a4-480a-8df2-41fcf5167931 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:53.346876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-674a87a3-46a4-480a-8df2-41fcf5167931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:53.415774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 482/933] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:53.416625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a87a3-46a4-480a-8df2-41fcf5167931 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.417285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cdaf7-01c3-4962-984e-5647fff06fa1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.459770 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36177ce4-6a20-4684-a5e5-1e694872bb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.461010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36177ce4-6a20-4684-a5e5-1e694872bb90 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.461296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36177ce4-6a20-4684-a5e5-1e694872bb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.461586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36177ce4-6a20-4684-a5e5-1e694872bb90 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.462497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36177ce4-6a20-4684-a5e5-1e694872bb90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:53.462808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36177ce4-6a20-4684-a5e5-1e694872bb90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.464333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36177ce4-6a20-4684-a5e5-1e694872bb90 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.465838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.474150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.487083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 452/934] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:53.493432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36177ce4-6a20-4684-a5e5-1e694872bb90 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.552382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a87a3-46a4-480a-8df2-41fcf5167931 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.588676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3705c-7fa5-4dc4-b850-24b19c9d2654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.589815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3705c-7fa5-4dc4-b850-24b19c9d2654 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.589815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3705c-7fa5-4dc4-b850-24b19c9d2654 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.590033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3705c-7fa5-4dc4-b850-24b19c9d2654 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.590458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3705c-7fa5-4dc4-b850-24b19c9d2654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.591881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3705c-7fa5-4dc4-b850-24b19c9d2654 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.603468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 483/935] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:27:53.635458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36177ce4-6a20-4684-a5e5-1e694872bb90 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.676625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c77d88-0844-40c6-82c1-ff1c857b358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.677653 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c77d88-0844-40c6-82c1-ff1c857b358e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.678147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c77d88-0844-40c6-82c1-ff1c857b358e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.678650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c77d88-0844-40c6-82c1-ff1c857b358e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.691882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c77d88-0844-40c6-82c1-ff1c857b358e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.693880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c77d88-0844-40c6-82c1-ff1c857b358e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.694932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3705c-7fa5-4dc4-b850-24b19c9d2654 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-73c77d88-0844-40c6-82c1-ff1c857b358e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:53.711642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:53.712729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:53.714098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:53.714098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:53.714098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:53.715166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 453/936] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:53.724577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c77d88-0844-40c6-82c1-ff1c857b358e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.784009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.814671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.828712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3705c-7fa5-4dc4-b850-24b19c9d2654 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.878091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c77d88-0844-40c6-82c1-ff1c857b358e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.886391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92558c3-f10e-4778-bb2a-b5dc5bc783d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.887448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92558c3-f10e-4778-bb2a-b5dc5bc783d9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.888383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92558c3-f10e-4778-bb2a-b5dc5bc783d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.888898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92558c3-f10e-4778-bb2a-b5dc5bc783d9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.890013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92558c3-f10e-4778-bb2a-b5dc5bc783d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.891906 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92558c3-f10e-4778-bb2a-b5dc5bc783d9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d92558c3-f10e-4778-bb2a-b5dc5bc783d9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:53.904871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:53.905876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:53.906803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:53.909043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 484/937] 10.222.0.88 () {56 vars in 1132 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:53.916998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92558c3-f10e-4778-bb2a-b5dc5bc783d9 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.921625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308493-be0b-4720-a80f-042da272b3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.922493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308493-be0b-4720-a80f-042da272b3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.922956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308493-be0b-4720-a80f-042da272b3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.923456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308493-be0b-4720-a80f-042da272b3d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.924305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89308493-be0b-4720-a80f-042da272b3d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:53.924789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89308493-be0b-4720-a80f-042da272b3d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.927106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89308493-be0b-4720-a80f-042da272b3d2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.945151 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 454/938] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:53.953084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308493-be0b-4720-a80f-042da272b3d2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:54.025207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92558c3-f10e-4778-bb2a-b5dc5bc783d9 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:54.061655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885eda05-4470-48a5-af8e-55ea92cae65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:54.062276 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885eda05-4470-48a5-af8e-55ea92cae65a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:54.062554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885eda05-4470-48a5-af8e-55ea92cae65a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:54.062824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885eda05-4470-48a5-af8e-55ea92cae65a None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:54.063505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885eda05-4470-48a5-af8e-55ea92cae65a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:54.063797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885eda05-4470-48a5-af8e-55ea92cae65a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:54.065314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885eda05-4470-48a5-af8e-55ea92cae65a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:54.074216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308493-be0b-4720-a80f-042da272b3d2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:54.084560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:54.103903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 485/939] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:54.105776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0833358-68b8-49c4-bb77-6fd8cb28799c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:54.106056 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0833358-68b8-49c4-bb77-6fd8cb28799c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:54.106327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0833358-68b8-49c4-bb77-6fd8cb28799c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:54.107620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 486/940] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:54.109648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0833358-68b8-49c4-bb77-6fd8cb28799c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:54.115970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6167b50-82db-4df5-8c04-154b836b0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:54.117178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6167b50-82db-4df5-8c04-154b836b0ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:54.117455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6167b50-82db-4df5-8c04-154b836b0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:54.117724 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6167b50-82db-4df5-8c04-154b836b0ce0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:54.126392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6167b50-82db-4df5-8c04-154b836b0ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:54.128677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6167b50-82db-4df5-8c04-154b836b0ce0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:54.138277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-d6167b50-82db-4df5-8c04-154b836b0ce0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:54.141422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:54.142314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:54.143233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:54.143233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:54.143233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:54.143233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:54.143233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:54.143233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:54.143233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:54.143233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:54.143233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 455/941] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:54.143732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503dc41-18f0-45c9-abe6-51a256347ecc None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:54.144117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503dc41-18f0-45c9-abe6-51a256347ecc None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:54.144271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503dc41-18f0-45c9-abe6-51a256347ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:54.162521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9503dc41-18f0-45c9-abe6-51a256347ecc None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:54.163809 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9503dc41-18f0-45c9-abe6-51a256347ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:54.226124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0833358-68b8-49c4-bb77-6fd8cb28799c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:54.239088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 456/942] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:54.239088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503dc41-18f0-45c9-abe6-51a256347ecc None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:54.280784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce953-474b-46b1-b6ad-c72b142a980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:54.282074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce953-474b-46b1-b6ad-c72b142a980a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:54.282658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce953-474b-46b1-b6ad-c72b142a980a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:54.283212 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce953-474b-46b1-b6ad-c72b142a980a None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:54.284013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce953-474b-46b1-b6ad-c72b142a980a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:54.284715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce953-474b-46b1-b6ad-c72b142a980a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:54.286990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce953-474b-46b1-b6ad-c72b142a980a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:54.294425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 487/943] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:54.300258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce953-474b-46b1-b6ad-c72b142a980a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:54.346456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:54.351936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503dc41-18f0-45c9-abe6-51a256347ecc None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:54.389887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6077-bda1-46f7-8ceb-339c61dbe650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:54.390774 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6077-bda1-46f7-8ceb-339c61dbe650 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:54.391373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6077-bda1-46f7-8ceb-339c61dbe650 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:54.391982 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6077-bda1-46f7-8ceb-339c61dbe650 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:54.392682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6077-bda1-46f7-8ceb-339c61dbe650 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:54.392992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6077-bda1-46f7-8ceb-339c61dbe650 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:54.394436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6077-bda1-46f7-8ceb-339c61dbe650 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:54.407608 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 457/944] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:54.413220 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:54.414058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6077-bda1-46f7-8ceb-339c61dbe650 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:54.431986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce953-474b-46b1-b6ad-c72b142a980a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:54.482721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fe922-872e-47cb-b3c8-c9d77a199de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:54.483947 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fe922-872e-47cb-b3c8-c9d77a199de3 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:54.484772 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fe922-872e-47cb-b3c8-c9d77a199de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:54.485488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fe922-872e-47cb-b3c8-c9d77a199de3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:54.486347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fe922-872e-47cb-b3c8-c9d77a199de3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:54.488188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fe922-872e-47cb-b3c8-c9d77a199de3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:54.525904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6077-bda1-46f7-8ceb-339c61dbe650 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:54.561673 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117fa64-c637-4f62-843c-8c38f170bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:54.562203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117fa64-c637-4f62-843c-8c38f170bdbd None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:54.562483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117fa64-c637-4f62-843c-8c38f170bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:54.562760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117fa64-c637-4f62-843c-8c38f170bdbd None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/d33c67fc513e49df9f6792475ff2d20e/roles/984fb3415f2747f89ce2d5bcd6089515` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:54.564955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117fa64-c637-4f62-843c-8c38f170bdbd None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=d33c67fc513e49df9f6792475ff2d20e, role_id=984fb3415f2747f89ce2d5bcd6089515)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:54.566395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117fa64-c637-4f62-843c-8c38f170bdbd None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:54.581694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 488/945] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:54.582690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fe922-872e-47cb-b3c8-c9d77a199de3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:54.654138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 458/946] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:54 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/d33c67fc513e49df9f6792475ff2d20e/roles/984fb3415f2747f89ce2d5bcd6089515 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:27:54.724211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fe922-872e-47cb-b3c8-c9d77a199de3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:54.773686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff1fc2-b0c0-424b-a52b-a8cc831335fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:54.774330 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff1fc2-b0c0-424b-a52b-a8cc831335fe None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:54.774616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff1fc2-b0c0-424b-a52b-a8cc831335fe None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:54.774894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff1fc2-b0c0-424b-a52b-a8cc831335fe None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:54.775663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff1fc2-b0c0-424b-a52b-a8cc831335fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:54.777140 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff1fc2-b0c0-424b-a52b-a8cc831335fe None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:54.779839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: WARNING keystone.server.flask.common [None req-70ff1fc2-b0c0-424b-a52b-a8cc831335fe None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 03:27:54.792695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:54.827418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.sql.core [None req-70ff1fc2-b0c0-424b-a52b-a8cc831335fe None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:27:54.827418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 03:27:54.827418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [parameters: {'id': 'c022e508655d4633be22e00d7157e1a7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 03:27:54.827418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81854) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-70ff1fc2-b0c0-424b-a52b-a8cc831335fe None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c022e508655d4633be22e00d7157e1a7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c022e508655d4633be22e00d7157e1a7. Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:54.845967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 03:27:54.846864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application yield resource Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise self.value Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application session.commit() Aug 24 03:27:54.847876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:27:54.849373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:27:54.850299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:54.851229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [parameters: {'id': 'c022e508655d4633be22e00d7157e1a7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:54.852115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:54.852927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:54.853833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:54.853833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 03:27:54.853833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 03:27:54.853833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:54.853833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:54.853833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 03:27:54.853833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 03:27:54.853833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c022e508655d4633be22e00d7157e1a7. Aug 24 03:27:54.853833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:54.853833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 489/947] 10.222.0.88 () {60 vars in 1140 bytes} [Wed Aug 24 03:27:54 2022] POST /identity/v3/projects => generated 262 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:54.856693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117fa64-c637-4f62-843c-8c38f170bdbd None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:54.893080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:54.985118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117fa64-c637-4f62-843c-8c38f170bdbd None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:55.022597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba296ba5-2434-49d7-96e2-d5c5f16774db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:55.023303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba296ba5-2434-49d7-96e2-d5c5f16774db None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:55.023589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba296ba5-2434-49d7-96e2-d5c5f16774db None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:55.023870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba296ba5-2434-49d7-96e2-d5c5f16774db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:55.031075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba296ba5-2434-49d7-96e2-d5c5f16774db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:55.037719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba296ba5-2434-49d7-96e2-d5c5f16774db None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-ba296ba5-2434-49d7-96e2-d5c5f16774db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:55.045112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:55.046010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:55.046896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:55.046896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:55.046896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:55.046896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:55.046896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:55.046896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:55.046896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:55.046896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:55.049135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 459/948] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:55.052965 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff1fc2-b0c0-424b-a52b-a8cc831335fe None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:55.160501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff1fc2-b0c0-424b-a52b-a8cc831335fe None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:55.196254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca88616-50f6-45b5-ac19-60593821eb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:55.196872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88616-50f6-45b5-ac19-60593821eb5a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:55.197153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88616-50f6-45b5-ac19-60593821eb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:55.197427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88616-50f6-45b5-ac19-60593821eb5a None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:55.198106 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca88616-50f6-45b5-ac19-60593821eb5a None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:55.198408 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca88616-50f6-45b5-ac19-60593821eb5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:55.200105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca88616-50f6-45b5-ac19-60593821eb5a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:55.223029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 490/949] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:55.660523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38000-c4fe-455a-aa84-806da45441ab None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:55.661043 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38000-c4fe-455a-aa84-806da45441ab None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:55.661345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38000-c4fe-455a-aa84-806da45441ab None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:55.663072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 460/950] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:55.668572 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b7070-2213-4c94-a23d-a47e911f537d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:55.668972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b7070-2213-4c94-a23d-a47e911f537d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:55.669355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b7070-2213-4c94-a23d-a47e911f537d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:55.688896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a67b7070-2213-4c94-a23d-a47e911f537d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:55.690451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a67b7070-2213-4c94-a23d-a47e911f537d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:55.745328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:55.762861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 491/951] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:56.039781 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa38000-c4fe-455a-aa84-806da45441ab None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.141230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:56.170032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa38000-c4fe-455a-aa84-806da45441ab None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.208739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2b1f0-9319-4c33-98ff-4adf85365c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.209382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b1f0-9319-4c33-98ff-4adf85365c04 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.209666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b1f0-9319-4c33-98ff-4adf85365c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.209941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b1f0-9319-4c33-98ff-4adf85365c04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.211087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2b1f0-9319-4c33-98ff-4adf85365c04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.212474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2b1f0-9319-4c33-98ff-4adf85365c04 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-b7a2b1f0-9319-4c33-98ff-4adf85365c04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:56.221534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:56.223793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:56.225817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 461/952] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:56.231131 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b7070-2213-4c94-a23d-a47e911f537d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.333676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b7070-2213-4c94-a23d-a47e911f537d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.370097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcfe99-8957-4858-bce6-795303e455ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.370709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcfe99-8957-4858-bce6-795303e455ac None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.370990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcfe99-8957-4858-bce6-795303e455ac None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.371291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcfe99-8957-4858-bce6-795303e455ac None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.371926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcfe99-8957-4858-bce6-795303e455ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:56.372232 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcfe99-8957-4858-bce6-795303e455ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.373616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcfe99-8957-4858-bce6-795303e455ac None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.378923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 492/953] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:56.384665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2b1f0-9319-4c33-98ff-4adf85365c04 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.503842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2b1f0-9319-4c33-98ff-4adf85365c04 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.542583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6bcd0-473d-4d3b-b1ae-3e1d54df5cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.543249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6bcd0-473d-4d3b-b1ae-3e1d54df5cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.543535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6bcd0-473d-4d3b-b1ae-3e1d54df5cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.543813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6bcd0-473d-4d3b-b1ae-3e1d54df5cb0 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.544455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6bcd0-473d-4d3b-b1ae-3e1d54df5cb0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:56.544760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6bcd0-473d-4d3b-b1ae-3e1d54df5cb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.546142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6bcd0-473d-4d3b-b1ae-3e1d54df5cb0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.551852 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 462/954] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:56.557612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcfe99-8957-4858-bce6-795303e455ac None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.615795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:56.666456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777f1dc-e2b5-456c-812f-4843014240b9 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.667031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777f1dc-e2b5-456c-812f-4843014240b9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.667031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777f1dc-e2b5-456c-812f-4843014240b9 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.668773 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 463/955] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:56.673907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230905d5-2c9e-439f-badc-4bd738de0731 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.674199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230905d5-2c9e-439f-badc-4bd738de0731 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.674480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230905d5-2c9e-439f-badc-4bd738de0731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.674959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcfe99-8957-4858-bce6-795303e455ac None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.691365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:56.693549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-230905d5-2c9e-439f-badc-4bd738de0731 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:56.695377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-230905d5-2c9e-439f-badc-4bd738de0731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:56.715680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9280a6-7029-4727-9d97-556b396e1a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.716294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9280a6-7029-4727-9d97-556b396e1a29 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.716575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9280a6-7029-4727-9d97-556b396e1a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.716846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9280a6-7029-4727-9d97-556b396e1a29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.717962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9280a6-7029-4727-9d97-556b396e1a29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.719379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9280a6-7029-4727-9d97-556b396e1a29 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.765196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 464/956] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:56.767667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e502be-5c18-443d-85e1-4fb4d66d32ed None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.767960 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e502be-5c18-443d-85e1-4fb4d66d32ed None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.768239 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e502be-5c18-443d-85e1-4fb4d66d32ed None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.769634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 465/957] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:56.775616 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0dbd-0b4b-4814-8422-512630f79f20 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.775898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0dbd-0b4b-4814-8422-512630f79f20 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.776173 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd0dbd-0b4b-4814-8422-512630f79f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.803318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 493/958] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:56.807074 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e8fd0dbd-0b4b-4814-8422-512630f79f20 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:56.807074 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e8fd0dbd-0b4b-4814-8422-512630f79f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:56.907904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 466/959] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:57.045986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9280a6-7029-4727-9d97-556b396e1a29 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:57.153137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9280a6-7029-4727-9d97-556b396e1a29 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:57.160928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:57.188356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd0dbd-0b4b-4814-8422-512630f79f20 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:57.189842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff728e-216d-40c7-b1a3-27fe85a15726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:57.190494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff728e-216d-40c7-b1a3-27fe85a15726 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:57.190782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff728e-216d-40c7-b1a3-27fe85a15726 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:57.191095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff728e-216d-40c7-b1a3-27fe85a15726 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:57.191771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff728e-216d-40c7-b1a3-27fe85a15726 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:57.193174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff728e-216d-40c7-b1a3-27fe85a15726 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-6eff728e-216d-40c7-b1a3-27fe85a15726 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:57.202894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:57.204137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:57.204994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:57.209480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 494/960] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:57.211285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff728e-216d-40c7-b1a3-27fe85a15726 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:57.261651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:57.306738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd0dbd-0b4b-4814-8422-512630f79f20 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:57.347843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b5248-9811-4a66-904c-29967ae895f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:57.348757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff728e-216d-40c7-b1a3-27fe85a15726 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:57.349416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b5248-9811-4a66-904c-29967ae895f4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:57.350007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b5248-9811-4a66-904c-29967ae895f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:57.350346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b5248-9811-4a66-904c-29967ae895f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:57.367507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b5248-9811-4a66-904c-29967ae895f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-085b5248-9811-4a66-904c-29967ae895f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:57.372780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:57.373720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:57.374578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 467/961] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:57.375662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379d5e3-645f-4584-961c-5ab107171850 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:57.375662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379d5e3-645f-4584-961c-5ab107171850 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:57.375796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379d5e3-645f-4584-961c-5ab107171850 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:57.380048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 468/962] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:57.380048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379d5e3-645f-4584-961c-5ab107171850 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:57.396482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7832c-21c6-41d5-ad25-0aa11ad4c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:57.397202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7832c-21c6-41d5-ad25-0aa11ad4c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:57.397452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7832c-21c6-41d5-ad25-0aa11ad4c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:57.398497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7832c-21c6-41d5-ad25-0aa11ad4c7d5 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:57.398918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7832c-21c6-41d5-ad25-0aa11ad4c7d5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:57.399322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7832c-21c6-41d5-ad25-0aa11ad4c7d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:57.400648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7832c-21c6-41d5-ad25-0aa11ad4c7d5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:57.405889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 495/963] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:57.406891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3dc3b-c7d7-4390-bbfd-40f2539b6948 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:57.407213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3dc3b-c7d7-4390-bbfd-40f2539b6948 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:57.407492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3dc3b-c7d7-4390-bbfd-40f2539b6948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:57.426435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0ea3dc3b-c7d7-4390-bbfd-40f2539b6948 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:57.427676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ea3dc3b-c7d7-4390-bbfd-40f2539b6948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:57.455938 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:57.495419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379d5e3-645f-4584-961c-5ab107171850 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:57.503816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 496/964] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:57.505008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3dc3b-c7d7-4390-bbfd-40f2539b6948 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:57.520666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:57.536509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c686409-222c-49c2-8d2e-f02204663de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:57.537349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c686409-222c-49c2-8d2e-f02204663de1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:57.537773 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c686409-222c-49c2-8d2e-f02204663de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:57.538803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c686409-222c-49c2-8d2e-f02204663de1 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:57.539792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c686409-222c-49c2-8d2e-f02204663de1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:57.540246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c686409-222c-49c2-8d2e-f02204663de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:57.541779 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c686409-222c-49c2-8d2e-f02204663de1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:57.555766 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 469/965] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:57.556934 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c686409-222c-49c2-8d2e-f02204663de1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:57.633564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3dc3b-c7d7-4390-bbfd-40f2539b6948 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:57.668526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c686409-222c-49c2-8d2e-f02204663de1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:57.681752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69736451-8c64-4f9c-a4a0-bb6cd01b6e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:57.682647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736451-8c64-4f9c-a4a0-bb6cd01b6e19 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:57.683190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736451-8c64-4f9c-a4a0-bb6cd01b6e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:57.683570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736451-8c64-4f9c-a4a0-bb6cd01b6e19 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:57.684315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69736451-8c64-4f9c-a4a0-bb6cd01b6e19 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:57.684730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69736451-8c64-4f9c-a4a0-bb6cd01b6e19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:57.686762 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69736451-8c64-4f9c-a4a0-bb6cd01b6e19 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:57.695209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 497/966] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:57.715981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66f1f6-42bf-4cfb-9058-3c854dcf8bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:57.716892 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66f1f6-42bf-4cfb-9058-3c854dcf8bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:57.717351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66f1f6-42bf-4cfb-9058-3c854dcf8bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:57.717779 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66f1f6-42bf-4cfb-9058-3c854dcf8bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:57.732091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66f1f6-42bf-4cfb-9058-3c854dcf8bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:57.733922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66f1f6-42bf-4cfb-9058-3c854dcf8bf8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-0e66f1f6-42bf-4cfb-9058-3c854dcf8bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:57.750292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:57.751567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:57.752601 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:57.752601 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:57.752601 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:57.754480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 470/967] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:57.760842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69736451-8c64-4f9c-a4a0-bb6cd01b6e19 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:57.771601 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66f1f6-42bf-4cfb-9058-3c854dcf8bf8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:57.797320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:57.819018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:57.907180 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66f1f6-42bf-4cfb-9058-3c854dcf8bf8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:57.908961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69736451-8c64-4f9c-a4a0-bb6cd01b6e19 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:57.945783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf5c1f-ad76-47f0-89dc-4b72e59551d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:57.946822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf5c1f-ad76-47f0-89dc-4b72e59551d7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:57.947297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf5c1f-ad76-47f0-89dc-4b72e59551d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:57.947736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf5c1f-ad76-47f0-89dc-4b72e59551d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:57.948145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e69312-bca1-48cf-8bb5-451c5bd89223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:57.948740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf5c1f-ad76-47f0-89dc-4b72e59551d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:57.948858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e69312-bca1-48cf-8bb5-451c5bd89223 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:57.949218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e69312-bca1-48cf-8bb5-451c5bd89223 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:57.949446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf5c1f-ad76-47f0-89dc-4b72e59551d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:57.949567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e69312-bca1-48cf-8bb5-451c5bd89223 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:57.950293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e69312-bca1-48cf-8bb5-451c5bd89223 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:57.951257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf5c1f-ad76-47f0-89dc-4b72e59551d7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:57.951875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e69312-bca1-48cf-8bb5-451c5bd89223 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:57.954946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: WARNING keystone.server.flask.common [None req-73e69312-bca1-48cf-8bb5-451c5bd89223 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 03:27:57.966049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 498/968] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:57.971272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf5c1f-ad76-47f0-89dc-4b72e59551d7 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:58.020739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.sql.core [None req-73e69312-bca1-48cf-8bb5-451c5bd89223 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:27:58.020739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 03:27:58.020739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [parameters: {'user_id': 'ee361cb08e9e42f7964be3a382c5a596', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 03:27:58.020739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81855) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-73e69312-bca1-48cf-8bb5-451c5bd89223 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:58.028066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:58.030981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application yield resource Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise self.value Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application session.commit() Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:27:58.032199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:27:58.033127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:58.034136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:58.035178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ee361cb08e9e42f7964be3a382c5a596', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:58.036036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 03:27:58.036884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 03:27:58.037950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 03:27:58.037950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 03:27:58.037950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:27:58.037950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:27:58.037950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 03:27:58.037950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:58.037950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 471/969] 10.222.0.88 () {60 vars in 1131 bytes} [Wed Aug 24 03:27:57 2022] POST /identity/v3/users => generated 160 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:58.040743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e69312-bca1-48cf-8bb5-451c5bd89223 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:58.084169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:58.100972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf5c1f-ad76-47f0-89dc-4b72e59551d7 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:58.150080 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254484c-d7f9-44b4-bc91-b94f5c552605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:58.150739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254484c-d7f9-44b4-bc91-b94f5c552605 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.151289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254484c-d7f9-44b4-bc91-b94f5c552605 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.151573 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254484c-d7f9-44b4-bc91-b94f5c552605 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.153482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:58.158034 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e69312-bca1-48cf-8bb5-451c5bd89223 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:58.162132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254484c-d7f9-44b4-bc91-b94f5c552605 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:58.163676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254484c-d7f9-44b4-bc91-b94f5c552605 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a254484c-d7f9-44b4-bc91-b94f5c552605 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:58.178530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:58.179902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:58.180875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:58.180875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:58.180875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:58.180875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:58.180875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:58.180875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:58.180875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:58.180875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:58.180875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:58.180875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:58.185703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 499/970] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:58.187487 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254484c-d7f9-44b4-bc91-b94f5c552605 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:58.202609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb348d-3017-4384-881f-47ded803f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:58.203317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb348d-3017-4384-881f-47ded803f5af None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.203677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb348d-3017-4384-881f-47ded803f5af None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.203955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb348d-3017-4384-881f-47ded803f5af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.211741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb348d-3017-4384-881f-47ded803f5af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:58.213326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb348d-3017-4384-881f-47ded803f5af None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-34eb348d-3017-4384-881f-47ded803f5af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:58.226718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:58.227738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:58.228702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:58.228702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:58.228702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:58.228702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:58.228702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:58.228702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:58.228702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:58.228702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:58.228702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:58.228702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:58.228702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 472/971] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:58.234452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb348d-3017-4384-881f-47ded803f5af None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:58.323955 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254484c-d7f9-44b4-bc91-b94f5c552605 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:58.361603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e9109-be91-49b2-97ff-490b8d9b585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:58.362245 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9109-be91-49b2-97ff-490b8d9b585f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.362517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9109-be91-49b2-97ff-490b8d9b585f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.362759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e9109-be91-49b2-97ff-490b8d9b585f None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.363597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e9109-be91-49b2-97ff-490b8d9b585f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:58.363902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e9109-be91-49b2-97ff-490b8d9b585f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:58.365355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e9109-be91-49b2-97ff-490b8d9b585f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:58.370615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb348d-3017-4384-881f-47ded803f5af None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:58.389674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 500/972] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:58.390866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e9109-be91-49b2-97ff-490b8d9b585f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:58.400274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:58.409698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea344b-1cca-47fc-8c2e-648eb608b0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:58.410599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea344b-1cca-47fc-8c2e-648eb608b0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.411030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea344b-1cca-47fc-8c2e-648eb608b0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.411473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea344b-1cca-47fc-8c2e-648eb608b0a1 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.413427 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea344b-1cca-47fc-8c2e-648eb608b0a1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:58.413427 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea344b-1cca-47fc-8c2e-648eb608b0a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:58.414606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea344b-1cca-47fc-8c2e-648eb608b0a1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:58.458388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 473/973] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 03:27:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:58.500818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e9109-be91-49b2-97ff-490b8d9b585f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:58.541128 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad19f76-ce5b-475b-b567-45c51d80b334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:58.541764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad19f76-ce5b-475b-b567-45c51d80b334 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.542049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad19f76-ce5b-475b-b567-45c51d80b334 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.542327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad19f76-ce5b-475b-b567-45c51d80b334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.625263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad19f76-ce5b-475b-b567-45c51d80b334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:58.626761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad19f76-ce5b-475b-b567-45c51d80b334 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:58.635579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:58.753495 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 501/974] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:58 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:58.753709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea344b-1cca-47fc-8c2e-648eb608b0a1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:58.759771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:58.849772 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea344b-1cca-47fc-8c2e-648eb608b0a1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:58.851842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418edf55-6f19-4d6b-949b-13db77fd126c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.852345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418edf55-6f19-4d6b-949b-13db77fd126c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.852833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418edf55-6f19-4d6b-949b-13db77fd126c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.855826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 502/975] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:58.865349 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed46c6-c4fb-4b7c-94a7-153bc270fba3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.865349 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed46c6-c4fb-4b7c-94a7-153bc270fba3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.865349 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed46c6-c4fb-4b7c-94a7-153bc270fba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.884057 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b6ed46c6-c4fb-4b7c-94a7-153bc270fba3 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:58.885316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b6ed46c6-c4fb-4b7c-94a7-153bc270fba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:58.898025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5a5e6-d6d9-48b9-893c-0de3933dd17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:58.898655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5a5e6-d6d9-48b9-893c-0de3933dd17b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.898937 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5a5e6-d6d9-48b9-893c-0de3933dd17b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.899243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5a5e6-d6d9-48b9-893c-0de3933dd17b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.909690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5a5e6-d6d9-48b9-893c-0de3933dd17b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:58.911175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5a5e6-d6d9-48b9-893c-0de3933dd17b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-80e5a5e6-d6d9-48b9-893c-0de3933dd17b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:58.928328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:58.929885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:58.930895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:58.930895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:58.930895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:58.935200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 474/976] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:58.939994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5a5e6-d6d9-48b9-893c-0de3933dd17b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:58.960695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 503/977] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:59.015576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.050638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5a5e6-d6d9-48b9-893c-0de3933dd17b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.085703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e92f8-47f4-4075-a778-1db59dd9775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.086312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e92f8-47f4-4075-a778-1db59dd9775b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.086595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e92f8-47f4-4075-a778-1db59dd9775b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.086925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e92f8-47f4-4075-a778-1db59dd9775b None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.087623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e92f8-47f4-4075-a778-1db59dd9775b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:59.087931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e92f8-47f4-4075-a778-1db59dd9775b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.089339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e92f8-47f4-4075-a778-1db59dd9775b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.107520 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 475/978] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:59.108579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed46c6-c4fb-4b7c-94a7-153bc270fba3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.152472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.228052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed46c6-c4fb-4b7c-94a7-153bc270fba3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.245866 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e92f8-47f4-4075-a778-1db59dd9775b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.264438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a076cd7-14d5-471f-bfaa-4801bae3ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.265083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a076cd7-14d5-471f-bfaa-4801bae3ad05 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.265369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a076cd7-14d5-471f-bfaa-4801bae3ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.265728 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a076cd7-14d5-471f-bfaa-4801bae3ad05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.273016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a076cd7-14d5-471f-bfaa-4801bae3ad05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.274475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a076cd7-14d5-471f-bfaa-4801bae3ad05 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-2a076cd7-14d5-471f-bfaa-4801bae3ad05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:59.285723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:59.286643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:59.292168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:59.292168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:59.292168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:59.292168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:59.292168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:59.292168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:59.292168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:59.292168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:27:59.292168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 504/979] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:59.295321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a076cd7-14d5-471f-bfaa-4801bae3ad05 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.353582 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e92f8-47f4-4075-a778-1db59dd9775b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.383158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.397981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.404835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d13cb-1ef7-4730-8f46-cdf1d7d4d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.404835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d13cb-1ef7-4730-8f46-cdf1d7d4d5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.404835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d13cb-1ef7-4730-8f46-cdf1d7d4d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.404835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d13cb-1ef7-4730-8f46-cdf1d7d4d5a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.405140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d13cb-1ef7-4730-8f46-cdf1d7d4d5a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.405233 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a076cd7-14d5-471f-bfaa-4801bae3ad05 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.405308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d13cb-1ef7-4730-8f46-cdf1d7d4d5a4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-b23d13cb-1ef7-4730-8f46-cdf1d7d4d5a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:59.414480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:59.415546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:27:59.416391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 476/980] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:59.421562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d13cb-1ef7-4730-8f46-cdf1d7d4d5a4 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.442413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e0988-6bde-475c-bbd1-f72eaf71f7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.443176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e0988-6bde-475c-bbd1-f72eaf71f7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.443461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e0988-6bde-475c-bbd1-f72eaf71f7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.443733 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e0988-6bde-475c-bbd1-f72eaf71f7f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.444515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e0988-6bde-475c-bbd1-f72eaf71f7f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:59.444824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e0988-6bde-475c-bbd1-f72eaf71f7f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.446262 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e0988-6bde-475c-bbd1-f72eaf71f7f4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.459390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 505/981] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:59.466122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e0988-6bde-475c-bbd1-f72eaf71f7f4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.534828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d13cb-1ef7-4730-8f46-cdf1d7d4d5a4 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.571353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4805ed4-fbf2-4740-acc0-ede9ce4a615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.571951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4805ed4-fbf2-4740-acc0-ede9ce4a615d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.572241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4805ed4-fbf2-4740-acc0-ede9ce4a615d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.572513 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4805ed4-fbf2-4740-acc0-ede9ce4a615d None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.573147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4805ed4-fbf2-4740-acc0-ede9ce4a615d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:59.573452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4805ed4-fbf2-4740-acc0-ede9ce4a615d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.575102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4805ed4-fbf2-4740-acc0-ede9ce4a615d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.583084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 477/982] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:59.586174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4805ed4-fbf2-4740-acc0-ede9ce4a615d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.586401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e0988-6bde-475c-bbd1-f72eaf71f7f4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.621714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b20971-f054-42d0-8724-b7cc9c9f18dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.622317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20971-f054-42d0-8724-b7cc9c9f18dd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.622592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20971-f054-42d0-8724-b7cc9c9f18dd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.622863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20971-f054-42d0-8724-b7cc9c9f18dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.623842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b20971-f054-42d0-8724-b7cc9c9f18dd None admin] RBAC: Adding query filter params (role.id=984fb3415f2747f89ce2d5bcd6089515, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=d33c67fc513e49df9f6792475ff2d20e) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:59.624150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b20971-f054-42d0-8724-b7cc9c9f18dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.625712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b20971-f054-42d0-8724-b7cc9c9f18dd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.631634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 506/983] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/role_assignments?user.id=d33c67fc513e49df9f6792475ff2d20e&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=984fb3415f2747f89ce2d5bcd6089515 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:59.662051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.687336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1323c-56f8-4028-bf9d-4f9a6a2c3d56 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.687737 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1323c-56f8-4028-bf9d-4f9a6a2c3d56 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.687908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1323c-56f8-4028-bf9d-4f9a6a2c3d56 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.689627 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 507/984] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:59.695852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be675688-71b3-42d5-919a-4728af43bb57 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.696135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be675688-71b3-42d5-919a-4728af43bb57 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.696381 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be675688-71b3-42d5-919a-4728af43bb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.716226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-be675688-71b3-42d5-919a-4728af43bb57 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:59.717458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be675688-71b3-42d5-919a-4728af43bb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:59.717595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4805ed4-fbf2-4740-acc0-ede9ce4a615d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.737772 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.757482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0c32c-7ae1-4428-acc2-f1c3468f9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.758166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c32c-7ae1-4428-acc2-f1c3468f9603 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.758384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c32c-7ae1-4428-acc2-f1c3468f9603 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.758655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c32c-7ae1-4428-acc2-f1c3468f9603 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.759343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0c32c-7ae1-4428-acc2-f1c3468f9603 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:59.759655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0c32c-7ae1-4428-acc2-f1c3468f9603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.761139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0c32c-7ae1-4428-acc2-f1c3468f9603 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.771634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 478/985] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:59.773359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0c32c-7ae1-4428-acc2-f1c3468f9603 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.804273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 508/986] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:59.891365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0c32c-7ae1-4428-acc2-f1c3468f9603 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.912512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.926696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cec9b-7a92-48b0-8cbe-d46e9b424343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.929398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cec9b-7a92-48b0-8cbe-d46e9b424343 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.929398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cec9b-7a92-48b0-8cbe-d46e9b424343 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.929398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cec9b-7a92-48b0-8cbe-d46e9b424343 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.929398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cec9b-7a92-48b0-8cbe-d46e9b424343 None admin] RBAC: Adding query filter params (interface=admin, service_id=8c1d97df318146c092019852c3c992f8, region_id=RegionOne) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:59.929398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cec9b-7a92-48b0-8cbe-d46e9b424343 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.930566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cec9b-7a92-48b0-8cbe-d46e9b424343 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.935893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 479/987] 10.222.0.88 () {56 vars in 1249 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/endpoints?service_id=8c1d97df318146c092019852c3c992f8&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:59.941591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be675688-71b3-42d5-919a-4728af43bb57 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:00.046616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be675688-71b3-42d5-919a-4728af43bb57 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:00.072800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cec9b-7a92-48b0-8cbe-d46e9b424343 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:00.083333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b79c92-349b-456a-a880-227e1df5aba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:00.083953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b79c92-349b-456a-a880-227e1df5aba8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:00.084237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b79c92-349b-456a-a880-227e1df5aba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:00.084517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b79c92-349b-456a-a880-227e1df5aba8 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:00.085677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b79c92-349b-456a-a880-227e1df5aba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:00.087077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b79c92-349b-456a-a880-227e1df5aba8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:00.093352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 509/988] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:28:00.189065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cec9b-7a92-48b0-8cbe-d46e9b424343 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:00.225323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba14e85-06a2-48be-8c05-effd287e0f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:00.226015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba14e85-06a2-48be-8c05-effd287e0f2a None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:00.226303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba14e85-06a2-48be-8c05-effd287e0f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:00.226603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba14e85-06a2-48be-8c05-effd287e0f2a None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:00.227259 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba14e85-06a2-48be-8c05-effd287e0f2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:00.228639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba14e85-06a2-48be-8c05-effd287e0f2a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:00.331256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 480/989] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:28:00 2022] POST /identity/v3/services => generated 242 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:28:01.605546 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ec820-d027-4d83-aa6d-331e76753436 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:01.606101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ec820-d027-4d83-aa6d-331e76753436 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:01.606101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ec820-d027-4d83-aa6d-331e76753436 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:01.607791 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 510/990] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:01.613103 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc907680-71c9-4266-8621-d92a82cbe965 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:01.613502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc907680-71c9-4266-8621-d92a82cbe965 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:01.613679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc907680-71c9-4266-8621-d92a82cbe965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:01.632481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-dc907680-71c9-4266-8621-d92a82cbe965 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:01.634001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dc907680-71c9-4266-8621-d92a82cbe965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:01.677268 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:01.715378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 481/991] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:01.984704 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ec820-d027-4d83-aa6d-331e76753436 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:01.999639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696eb80-a2cf-47a2-9b30-d8416fb97c0a None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:01.999936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696eb80-a2cf-47a2-9b30-d8416fb97c0a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.000308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696eb80-a2cf-47a2-9b30-d8416fb97c0a None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.001218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.002019 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 482/992] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:28:02.007326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd2d9c-b47e-42b6-9317-e482a74aa99f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.007642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd2d9c-b47e-42b6-9317-e482a74aa99f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.007924 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd2d9c-b47e-42b6-9317-e482a74aa99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.026636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-99fd2d9c-b47e-42b6-9317-e482a74aa99f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:02.027946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-99fd2d9c-b47e-42b6-9317-e482a74aa99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:02.096391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ec820-d027-4d83-aa6d-331e76753436 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.098098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 483/993] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:28:02.135470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca530c-6505-42e0-9619-3a8db32bbf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.136335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca530c-6505-42e0-9619-3a8db32bbf62 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.136757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca530c-6505-42e0-9619-3a8db32bbf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.137169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca530c-6505-42e0-9619-3a8db32bbf62 None admin] PATH_INFO: `/v3/services/image` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.137898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca530c-6505-42e0-9619-3a8db32bbf62 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.139561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca530c-6505-42e0-9619-3a8db32bbf62 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-12ca530c-6505-42e0-9619-3a8db32bbf62 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:02.148924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:02.150085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:28:02.151133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:02.152437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 511/994] 10.222.0.88 () {56 vars in 1105 bytes} [Wed Aug 24 03:28:01 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:02.158258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd2d9c-b47e-42b6-9317-e482a74aa99f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.258201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.261054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ad794-e84a-4fe6-a72f-af556b282ab8 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.261345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ad794-e84a-4fe6-a72f-af556b282ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.261624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ad794-e84a-4fe6-a72f-af556b282ab8 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.262011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd2d9c-b47e-42b6-9317-e482a74aa99f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.263151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 512/995] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:28:02.267889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b99eb-5924-4f0f-b7bd-6b7b58596a56 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.268173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b99eb-5924-4f0f-b7bd-6b7b58596a56 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.268451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b99eb-5924-4f0f-b7bd-6b7b58596a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.286148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-453b99eb-5924-4f0f-b7bd-6b7b58596a56 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:02.287372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-453b99eb-5924-4f0f-b7bd-6b7b58596a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:02.297778 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc788031-1459-43e8-bed3-28a7dc24cbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.298388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc788031-1459-43e8-bed3-28a7dc24cbcc None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.298667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc788031-1459-43e8-bed3-28a7dc24cbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.298936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc788031-1459-43e8-bed3-28a7dc24cbcc None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.299597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc788031-1459-43e8-bed3-28a7dc24cbcc None admin] RBAC: Adding query filter params (name=image) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:02.299900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc788031-1459-43e8-bed3-28a7dc24cbcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.301263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc788031-1459-43e8-bed3-28a7dc24cbcc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.306687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 484/996] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:02.312375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc788031-1459-43e8-bed3-28a7dc24cbcc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.363526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 513/997] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:28:02.364438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b99eb-5924-4f0f-b7bd-6b7b58596a56 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.377212 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.417983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc788031-1459-43e8-bed3-28a7dc24cbcc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.457346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c568a-d9ac-4dda-9522-fceb1e7746c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.458092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c568a-d9ac-4dda-9522-fceb1e7746c9 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.458688 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c568a-d9ac-4dda-9522-fceb1e7746c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.458966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c568a-d9ac-4dda-9522-fceb1e7746c9 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.459905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c568a-d9ac-4dda-9522-fceb1e7746c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:02.460213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c568a-d9ac-4dda-9522-fceb1e7746c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.462311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c568a-d9ac-4dda-9522-fceb1e7746c9 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.466758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b99eb-5924-4f0f-b7bd-6b7b58596a56 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.470946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 485/998] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:02.515495 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf43212-21b8-494e-9488-97bec6388e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.516165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf43212-21b8-494e-9488-97bec6388e05 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.516449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf43212-21b8-494e-9488-97bec6388e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.516722 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf43212-21b8-494e-9488-97bec6388e05 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.517326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf43212-21b8-494e-9488-97bec6388e05 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.518753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf43212-21b8-494e-9488-97bec6388e05 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-3cf43212-21b8-494e-9488-97bec6388e05 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:02.528923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:02.529997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:02.532148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 514/999] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:02.536356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c568a-d9ac-4dda-9522-fceb1e7746c9 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.569492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.631490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf43212-21b8-494e-9488-97bec6388e05 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.652572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c568a-d9ac-4dda-9522-fceb1e7746c9 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.693583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f1af0-990c-41be-aefa-3c8a1ba0168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.694151 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f1af0-990c-41be-aefa-3c8a1ba0168b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.694438 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f1af0-990c-41be-aefa-3c8a1ba0168b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.694718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f1af0-990c-41be-aefa-3c8a1ba0168b None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.695464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f1af0-990c-41be-aefa-3c8a1ba0168b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:02.695884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f1af0-990c-41be-aefa-3c8a1ba0168b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.697153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f1af0-990c-41be-aefa-3c8a1ba0168b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.702361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 486/1000] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:02.707881 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f1af0-990c-41be-aefa-3c8a1ba0168b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.713915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.754776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf43212-21b8-494e-9488-97bec6388e05 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.790460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584b81f-ccc4-45e7-a56e-335ac013dae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.791141 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584b81f-ccc4-45e7-a56e-335ac013dae4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.791429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584b81f-ccc4-45e7-a56e-335ac013dae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.791702 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584b81f-ccc4-45e7-a56e-335ac013dae4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.792296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584b81f-ccc4-45e7-a56e-335ac013dae4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.793680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584b81f-ccc4-45e7-a56e-335ac013dae4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f584b81f-ccc4-45e7-a56e-335ac013dae4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:02.803098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:02.804720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:02.805657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 515/1001] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:28:02.810077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.810486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584b81f-ccc4-45e7-a56e-335ac013dae4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.820067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f1af0-990c-41be-aefa-3c8a1ba0168b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.854789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ea054-2389-4e5e-8005-15415149d365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.855480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea054-2389-4e5e-8005-15415149d365 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.855757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea054-2389-4e5e-8005-15415149d365 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.856022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea054-2389-4e5e-8005-15415149d365 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.856654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ea054-2389-4e5e-8005-15415149d365 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:02.856954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ea054-2389-4e5e-8005-15415149d365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.858530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ea054-2389-4e5e-8005-15415149d365 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.869518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 487/1002] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:02.870401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ea054-2389-4e5e-8005-15415149d365 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.938199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584b81f-ccc4-45e7-a56e-335ac013dae4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.974286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18346-4d80-418c-b309-5e1c15c6bea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.975013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18346-4d80-418c-b309-5e1c15c6bea2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.975376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18346-4d80-418c-b309-5e1c15c6bea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.976376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18346-4d80-418c-b309-5e1c15c6bea2 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.976899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea18346-4d80-418c-b309-5e1c15c6bea2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:02.977201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea18346-4d80-418c-b309-5e1c15c6bea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.978676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea18346-4d80-418c-b309-5e1c15c6bea2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.979550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ea054-2389-4e5e-8005-15415149d365 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.980787 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.988926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 516/1003] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:02.990201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18346-4d80-418c-b309-5e1c15c6bea2 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:03.018217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f73d5-7185-4b4e-a90f-d27364973dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:03.018830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f73d5-7185-4b4e-a90f-d27364973dba None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:03.019140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f73d5-7185-4b4e-a90f-d27364973dba None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:03.019417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f73d5-7185-4b4e-a90f-d27364973dba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:03.020102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f73d5-7185-4b4e-a90f-d27364973dba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:03.021466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f73d5-7185-4b4e-a90f-d27364973dba None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:03.094657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18346-4d80-418c-b309-5e1c15c6bea2 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:03.124554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 488/1004] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:28:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:03.136962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018f423-231a-4826-8af4-933cabe5d3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:03.137649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018f423-231a-4826-8af4-933cabe5d3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:03.137931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018f423-231a-4826-8af4-933cabe5d3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:03.138206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018f423-231a-4826-8af4-933cabe5d3f8 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:03.139107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018f423-231a-4826-8af4-933cabe5d3f8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:03.139260 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018f423-231a-4826-8af4-933cabe5d3f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:03.145087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018f423-231a-4826-8af4-933cabe5d3f8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:03.155447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 517/1005] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:03.157746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f73d5-7185-4b4e-a90f-d27364973dba None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:03.179424 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:03.272319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f73d5-7185-4b4e-a90f-d27364973dba None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:03.307726 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71905d0-03a3-4a34-8d41-0665a5118512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:03.308346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71905d0-03a3-4a34-8d41-0665a5118512 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:03.308628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71905d0-03a3-4a34-8d41-0665a5118512 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:03.308904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71905d0-03a3-4a34-8d41-0665a5118512 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:03.309611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71905d0-03a3-4a34-8d41-0665a5118512 None admin] RBAC: Adding query filter params (interface=public, service_id=43e96a12a2b7451e8b3d639dee4a47bc, region_id=RegionOne) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:03.309931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71905d0-03a3-4a34-8d41-0665a5118512 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:03.311334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71905d0-03a3-4a34-8d41-0665a5118512 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:03.316571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 489/1006] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 03:28:03 2022] GET /identity/v3/endpoints?service_id=43e96a12a2b7451e8b3d639dee4a47bc&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:03.322777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018f423-231a-4826-8af4-933cabe5d3f8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:03.382166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:03.433713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018f423-231a-4826-8af4-933cabe5d3f8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:03.468470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b583b39-58ee-413f-b70c-356c74dd97ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:03.469085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583b39-58ee-413f-b70c-356c74dd97ca None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:03.469369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583b39-58ee-413f-b70c-356c74dd97ca None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:03.469643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583b39-58ee-413f-b70c-356c74dd97ca None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:03.470261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b583b39-58ee-413f-b70c-356c74dd97ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:03.471669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b583b39-58ee-413f-b70c-356c74dd97ca None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:03.487227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 518/1007] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 03:28:03 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:28:04.398834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aff45-e4af-440b-8eaa-06cd4d9413da None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:04.399424 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aff45-e4af-440b-8eaa-06cd4d9413da None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:04.399424 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aff45-e4af-440b-8eaa-06cd4d9413da None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:04.400907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 490/1008] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:04.405848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49828c6d-6011-4928-a9c9-e5c6dabd6b16 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:04.406240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49828c6d-6011-4928-a9c9-e5c6dabd6b16 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:04.406459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49828c6d-6011-4928-a9c9-e5c6dabd6b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:04.424899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-49828c6d-6011-4928-a9c9-e5c6dabd6b16 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:04.426095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-49828c6d-6011-4928-a9c9-e5c6dabd6b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:04.497193 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 519/1009] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:04 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:04.765029 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aff45-e4af-440b-8eaa-06cd4d9413da None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:04.858478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:04.883671 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aff45-e4af-440b-8eaa-06cd4d9413da None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:04.919930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f31b17-276a-49e6-b9db-a6a80b49f8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:04.920549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f31b17-276a-49e6-b9db-a6a80b49f8f0 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:04.920781 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f31b17-276a-49e6-b9db-a6a80b49f8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:04.921049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f31b17-276a-49e6-b9db-a6a80b49f8f0 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:04.921715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f31b17-276a-49e6-b9db-a6a80b49f8f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:04.923111 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f31b17-276a-49e6-b9db-a6a80b49f8f0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:05.007093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 491/1010] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:28:04 2022] POST /identity/v3/services => generated 242 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:05.055415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03f91-a061-455a-926d-c15694c44e81 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:05.055619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03f91-a061-455a-926d-c15694c44e81 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:05.055870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03f91-a061-455a-926d-c15694c44e81 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:05.057453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 520/1011] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:05.063156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1e0e-70a6-4168-aa2c-1877b40017b7 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:05.063446 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1e0e-70a6-4168-aa2c-1877b40017b7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:05.063722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1e0e-70a6-4168-aa2c-1877b40017b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:05.083693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-81aa1e0e-70a6-4168-aa2c-1877b40017b7 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:05.085117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-81aa1e0e-70a6-4168-aa2c-1877b40017b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:05.210469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 492/1012] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:05 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:05.410970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088473d3-d95e-4718-930c-b04c454380f6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:05.411516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088473d3-d95e-4718-930c-b04c454380f6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:05.411516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088473d3-d95e-4718-930c-b04c454380f6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:05.412976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 521/1013] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:05.418120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078290f2-bc87-4204-b2a3-8d45cb049aba None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:05.418500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078290f2-bc87-4204-b2a3-8d45cb049aba None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:05.418674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078290f2-bc87-4204-b2a3-8d45cb049aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:05.438008 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-078290f2-bc87-4204-b2a3-8d45cb049aba None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:05.439216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-078290f2-bc87-4204-b2a3-8d45cb049aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:05.478620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088473d3-d95e-4718-930c-b04c454380f6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:05.511212 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:05.519088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 493/1014] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:05 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:05.541061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:05.585176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088473d3-d95e-4718-930c-b04c454380f6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:05.620010 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a59b7-3667-4370-85ba-f2a440020d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:05.620583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a59b7-3667-4370-85ba-f2a440020d3e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:05.621250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a59b7-3667-4370-85ba-f2a440020d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:05.621917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a59b7-3667-4370-85ba-f2a440020d3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:05.623758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a59b7-3667-4370-85ba-f2a440020d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:05.625230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a59b7-3667-4370-85ba-f2a440020d3e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:05.627090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 522/1015] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:05.632644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078290f2-bc87-4204-b2a3-8d45cb049aba None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:05.735641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078290f2-bc87-4204-b2a3-8d45cb049aba None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:05.769895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37517f-e1e5-4c8b-9200-73d019fce964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:05.770501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37517f-e1e5-4c8b-9200-73d019fce964 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:05.770786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37517f-e1e5-4c8b-9200-73d019fce964 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:05.771084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37517f-e1e5-4c8b-9200-73d019fce964 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:05.771730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37517f-e1e5-4c8b-9200-73d019fce964 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:05.773280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37517f-e1e5-4c8b-9200-73d019fce964 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:05.785161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a59b7-3667-4370-85ba-f2a440020d3e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:05.873056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 494/1016] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:28:05 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:05.893899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a59b7-3667-4370-85ba-f2a440020d3e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:05.922227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:05.934699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284177-fbac-4016-9f2f-049ef3d1df5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:05.935386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284177-fbac-4016-9f2f-049ef3d1df5f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:05.935673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284177-fbac-4016-9f2f-049ef3d1df5f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:05.936047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284177-fbac-4016-9f2f-049ef3d1df5f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:05.936561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7284177-fbac-4016-9f2f-049ef3d1df5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:05.937977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7284177-fbac-4016-9f2f-049ef3d1df5f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c7284177-fbac-4016-9f2f-049ef3d1df5f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:05.947730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:05.948830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:28:05.949679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:05.954202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 523/1017] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:28:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:28:05.955575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37517f-e1e5-4c8b-9200-73d019fce964 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:06.013481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:06.067780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37517f-e1e5-4c8b-9200-73d019fce964 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:06.104664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0c7ae-432a-46e0-933e-55caa2ae8cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:06.105302 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0c7ae-432a-46e0-933e-55caa2ae8cad None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:06.105579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0c7ae-432a-46e0-933e-55caa2ae8cad None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:06.105849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0c7ae-432a-46e0-933e-55caa2ae8cad None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:06.106501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0c7ae-432a-46e0-933e-55caa2ae8cad None admin] RBAC: Adding query filter params (name=compute) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:06.106802 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0c7ae-432a-46e0-933e-55caa2ae8cad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:06.108374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0c7ae-432a-46e0-933e-55caa2ae8cad None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:06.114301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 495/1018] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:28:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:06.119950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284177-fbac-4016-9f2f-049ef3d1df5f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:06.221806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284177-fbac-4016-9f2f-049ef3d1df5f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:06.256922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751853d6-f2f1-4b73-850c-9a0e91d4bbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:06.258366 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751853d6-f2f1-4b73-850c-9a0e91d4bbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:06.261801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751853d6-f2f1-4b73-850c-9a0e91d4bbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:06.262467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751853d6-f2f1-4b73-850c-9a0e91d4bbb2 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:06.263146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751853d6-f2f1-4b73-850c-9a0e91d4bbb2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:06.263468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751853d6-f2f1-4b73-850c-9a0e91d4bbb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:06.264919 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751853d6-f2f1-4b73-850c-9a0e91d4bbb2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:06.270263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 524/1019] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 03:28:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:06.276312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0c7ae-432a-46e0-933e-55caa2ae8cad None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:06.377922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0c7ae-432a-46e0-933e-55caa2ae8cad None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:06.394987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:06.416388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736173c-2b03-4c3c-90ad-18c5c7d5004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:06.417003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736173c-2b03-4c3c-90ad-18c5c7d5004b None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:06.417290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736173c-2b03-4c3c-90ad-18c5c7d5004b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:06.417573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736173c-2b03-4c3c-90ad-18c5c7d5004b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:06.418250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736173c-2b03-4c3c-90ad-18c5c7d5004b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:06.419674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736173c-2b03-4c3c-90ad-18c5c7d5004b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:06.525521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 496/1020] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:28:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:06.942835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba830dc-2956-4fce-a897-26a6a8e28b04 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:06.943372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba830dc-2956-4fce-a897-26a6a8e28b04 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:06.943480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba830dc-2956-4fce-a897-26a6a8e28b04 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:06.945524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 525/1021] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:06.950600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8e038-381f-4dc4-947b-3e9256219830 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:06.950890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8e038-381f-4dc4-947b-3e9256219830 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:06.951194 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8e038-381f-4dc4-947b-3e9256219830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:06.971000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-95c8e038-381f-4dc4-947b-3e9256219830 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:06.972224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-95c8e038-381f-4dc4-947b-3e9256219830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:07.050313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 497/1022] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:07.315034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba830dc-2956-4fce-a897-26a6a8e28b04 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:07.366904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:07.418199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba830dc-2956-4fce-a897-26a6a8e28b04 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:07.450836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eafed0-4e86-4bbb-9571-0c485dbde684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:07.451482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eafed0-4e86-4bbb-9571-0c485dbde684 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.451761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eafed0-4e86-4bbb-9571-0c485dbde684 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.452027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eafed0-4e86-4bbb-9571-0c485dbde684 None admin] PATH_INFO: `/v3/services/image` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.452600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eafed0-4e86-4bbb-9571-0c485dbde684 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:07.453960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eafed0-4e86-4bbb-9571-0c485dbde684 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-55eafed0-4e86-4bbb-9571-0c485dbde684 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:07.463355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:07.464365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:28:07.465208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:07.472472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 526/1023] 10.222.0.88 () {56 vars in 1105 bytes} [Wed Aug 24 03:28:07 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:07.472654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8e038-381f-4dc4-947b-3e9256219830 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:07.565731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:07.572763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8e038-381f-4dc4-947b-3e9256219830 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:07.608635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4a75c-cb9d-4427-b09d-ea553f40c6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:07.609250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4a75c-cb9d-4427-b09d-ea553f40c6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.609534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4a75c-cb9d-4427-b09d-ea553f40c6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.609810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4a75c-cb9d-4427-b09d-ea553f40c6c8 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.610453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4a75c-cb9d-4427-b09d-ea553f40c6c8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:07.610762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4a75c-cb9d-4427-b09d-ea553f40c6c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:07.612176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4a75c-cb9d-4427-b09d-ea553f40c6c8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:07.622466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 498/1024] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:07.623889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eafed0-4e86-4bbb-9571-0c485dbde684 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:07.729276 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eafed0-4e86-4bbb-9571-0c485dbde684 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:07.744165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:07.764268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1b4ad-371a-42c6-bd2b-38a20db97b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:07.764873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1b4ad-371a-42c6-bd2b-38a20db97b65 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.765150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1b4ad-371a-42c6-bd2b-38a20db97b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.765427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1b4ad-371a-42c6-bd2b-38a20db97b65 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.766056 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1b4ad-371a-42c6-bd2b-38a20db97b65 None admin] RBAC: Adding query filter params (type=image) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:07.766359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1b4ad-371a-42c6-bd2b-38a20db97b65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:07.767757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1b4ad-371a-42c6-bd2b-38a20db97b65 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:07.777742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 527/1025] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:07.779375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4a75c-cb9d-4427-b09d-ea553f40c6c8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:07.867687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8235ea-c550-4842-b80a-cec077f4195b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.868361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8235ea-c550-4842-b80a-cec077f4195b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.868361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8235ea-c550-4842-b80a-cec077f4195b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.869496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 528/1026] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:07.874385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ba03d-cdb7-49f9-8c3d-eecef8da0dbf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.874672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ba03d-cdb7-49f9-8c3d-eecef8da0dbf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.874952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ba03d-cdb7-49f9-8c3d-eecef8da0dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.893131 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b03ba03d-cdb7-49f9-8c3d-eecef8da0dbf None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:07.894333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b03ba03d-cdb7-49f9-8c3d-eecef8da0dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:07.894438 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4a75c-cb9d-4427-b09d-ea553f40c6c8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:07.929496 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c3951-526d-4e1d-b54d-03749314307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:07.930108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c3951-526d-4e1d-b54d-03749314307e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.930392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c3951-526d-4e1d-b54d-03749314307e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.930669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c3951-526d-4e1d-b54d-03749314307e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.931522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c3951-526d-4e1d-b54d-03749314307e None admin] RBAC: Adding query filter params (interface=public, service_id=2d69c5b93fff4dad8085ce5d97987ac2, region_id=RegionOne) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:07.931843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c3951-526d-4e1d-b54d-03749314307e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:07.933219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c3951-526d-4e1d-b54d-03749314307e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:07.938307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 499/1027] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 03:28:07 2022] GET /identity/v3/endpoints?service_id=2d69c5b93fff4dad8085ce5d97987ac2&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:07.944456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c3951-526d-4e1d-b54d-03749314307e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:07.967073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 529/1028] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:28:07.973941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:08.050746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c3951-526d-4e1d-b54d-03749314307e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:08.086325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a89de-a02f-4f05-ad0c-0fec5a230569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:08.086989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a89de-a02f-4f05-ad0c-0fec5a230569 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:08.087351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a89de-a02f-4f05-ad0c-0fec5a230569 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:08.087684 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a89de-a02f-4f05-ad0c-0fec5a230569 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:08.088305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a89de-a02f-4f05-ad0c-0fec5a230569 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:08.089686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a89de-a02f-4f05-ad0c-0fec5a230569 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:08.096807 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 500/1029] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 03:28:07 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:28:08.239851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ba03d-cdb7-49f9-8c3d-eecef8da0dbf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:08.342285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ba03d-cdb7-49f9-8c3d-eecef8da0dbf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:08.352602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:08.377568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8733c6-fab4-493a-8d51-07c77b225c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:08.378312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8733c6-fab4-493a-8d51-07c77b225c93 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:08.378604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8733c6-fab4-493a-8d51-07c77b225c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:08.378932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8733c6-fab4-493a-8d51-07c77b225c93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:08.380078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8733c6-fab4-493a-8d51-07c77b225c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:08.381595 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8733c6-fab4-493a-8d51-07c77b225c93 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:08.383373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 530/1030] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:08.388915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a89de-a02f-4f05-ad0c-0fec5a230569 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:08.477279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:08.494007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a89de-a02f-4f05-ad0c-0fec5a230569 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:08.529771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ca28-966a-44ea-936d-d9f0dbd3cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:08.530385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ca28-966a-44ea-936d-d9f0dbd3cb08 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:08.530669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ca28-966a-44ea-936d-d9f0dbd3cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:08.530946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ca28-966a-44ea-936d-d9f0dbd3cb08 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:08.531686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3ca28-966a-44ea-936d-d9f0dbd3cb08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:08.533136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3ca28-966a-44ea-936d-d9f0dbd3cb08 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:08.546064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9c3f2-0751-4f0b-a249-0d27ba385244 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:08.546350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9c3f2-0751-4f0b-a249-0d27ba385244 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:08.546627 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9c3f2-0751-4f0b-a249-0d27ba385244 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:08.548017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 531/1031] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:28:08.553146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70d52f-8fd0-48dc-8e99-04656a5acfb6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:08.557778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70d52f-8fd0-48dc-8e99-04656a5acfb6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:08.557778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70d52f-8fd0-48dc-8e99-04656a5acfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:08.572149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9f70d52f-8fd0-48dc-8e99-04656a5acfb6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:08.573339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9f70d52f-8fd0-48dc-8e99-04656a5acfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:08.633790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 501/1032] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:28:08 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:08.642260 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 532/1033] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:28:08.916241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ca28-966a-44ea-936d-d9f0dbd3cb08 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:09.022990 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ca28-966a-44ea-936d-d9f0dbd3cb08 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:09.060287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0183b3-cd96-4f2e-92a2-23b9c237e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:09.061000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0183b3-cd96-4f2e-92a2-23b9c237e011 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:09.061281 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0183b3-cd96-4f2e-92a2-23b9c237e011 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:09.061555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0183b3-cd96-4f2e-92a2-23b9c237e011 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:09.072919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0183b3-cd96-4f2e-92a2-23b9c237e011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-5f0183b3-cd96-4f2e-92a2-23b9c237e011 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:09.077610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:09.078568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:09.079460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 502/1034] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 03:28:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:28:09.086801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70d52f-8fd0-48dc-8e99-04656a5acfb6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:09.189084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70d52f-8fd0-48dc-8e99-04656a5acfb6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:09.198287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:09.226893 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0906fc4-2ad9-47ce-8ce1-ff487622d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:09.227819 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906fc4-2ad9-47ce-8ce1-ff487622d0da None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:09.228117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906fc4-2ad9-47ce-8ce1-ff487622d0da None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:09.228395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906fc4-2ad9-47ce-8ce1-ff487622d0da None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:09.229326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0906fc4-2ad9-47ce-8ce1-ff487622d0da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:09.229632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0906fc4-2ad9-47ce-8ce1-ff487622d0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:09.231015 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0906fc4-2ad9-47ce-8ce1-ff487622d0da None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:09.239442 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 533/1035] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 03:28:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:09.245522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0183b3-cd96-4f2e-92a2-23b9c237e011 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:09.248444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:09.351829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0183b3-cd96-4f2e-92a2-23b9c237e011 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:09.390985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64effb-0825-4cae-81a9-5ca60a7852a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:09.390985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64effb-0825-4cae-81a9-5ca60a7852a1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:09.390985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64effb-0825-4cae-81a9-5ca60a7852a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:09.391644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64effb-0825-4cae-81a9-5ca60a7852a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:09.402220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64effb-0825-4cae-81a9-5ca60a7852a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:09.403697 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64effb-0825-4cae-81a9-5ca60a7852a1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-4d64effb-0825-4cae-81a9-5ca60a7852a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:28:09.418072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:09.418997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:28:09.420222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:28:09.420222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:09.420222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:09.420776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 503/1036] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:09.425091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0906fc4-2ad9-47ce-8ce1-ff487622d0da None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:09.534277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0906fc4-2ad9-47ce-8ce1-ff487622d0da None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:09.576879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc09064-168e-4459-9c22-ce299f91d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:09.577490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09064-168e-4459-9c22-ce299f91d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:09.577766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09064-168e-4459-9c22-ce299f91d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:09.578039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09064-168e-4459-9c22-ce299f91d6a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:09.578679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc09064-168e-4459-9c22-ce299f91d6a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:09.578980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc09064-168e-4459-9c22-ce299f91d6a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:09.580373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc09064-168e-4459-9c22-ce299f91d6a8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:09.592379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 534/1037] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:09.597836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64effb-0825-4cae-81a9-5ca60a7852a1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:09.657060 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:09.703790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64effb-0825-4cae-81a9-5ca60a7852a1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:09.738605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7043944-1ff0-4f1d-b2c9-7b4c072e2986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:09.739259 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7043944-1ff0-4f1d-b2c9-7b4c072e2986 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:09.739543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7043944-1ff0-4f1d-b2c9-7b4c072e2986 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:09.739803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7043944-1ff0-4f1d-b2c9-7b4c072e2986 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:09.747444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7043944-1ff0-4f1d-b2c9-7b4c072e2986 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:09.748979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7043944-1ff0-4f1d-b2c9-7b4c072e2986 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c7043944-1ff0-4f1d-b2c9-7b4c072e2986 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:28:09.760442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:09.761456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:09.762431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:09.762431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:09.762431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:28:09.762431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:28:09.762431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:28:09.762431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:28:09.762431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:28:09.762431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:28:09.762431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:28:09.762431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:09.767092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 504/1038] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 03:28:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:09.767916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc09064-168e-4459-9c22-ce299f91d6a8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:09.798502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:09.880014 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc09064-168e-4459-9c22-ce299f91d6a8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:09.924861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16795800-e24f-4de5-bec4-6a2d7331506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:09.925730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16795800-e24f-4de5-bec4-6a2d7331506d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:09.926165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16795800-e24f-4de5-bec4-6a2d7331506d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:09.926670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16795800-e24f-4de5-bec4-6a2d7331506d None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:09.927659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16795800-e24f-4de5-bec4-6a2d7331506d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:09.929839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16795800-e24f-4de5-bec4-6a2d7331506d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:09.931498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16795800-e24f-4de5-bec4-6a2d7331506d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:09.953690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 535/1039] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 03:28:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:09.961590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7043944-1ff0-4f1d-b2c9-7b4c072e2986 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:10.067641 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4bef-1fd2-4715-af68-3f21501c997e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.067861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4bef-1fd2-4715-af68-3f21501c997e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.068110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4bef-1fd2-4715-af68-3f21501c997e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.070009 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 536/1040] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:28:10.071591 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7043944-1ff0-4f1d-b2c9-7b4c072e2986 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:10.075342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9640049-4c6b-41dc-8645-90f901c41247 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.075670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9640049-4c6b-41dc-8645-90f901c41247 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.075910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9640049-4c6b-41dc-8645-90f901c41247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.088281 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:10.094489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b9640049-4c6b-41dc-8645-90f901c41247 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:10.095712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b9640049-4c6b-41dc-8645-90f901c41247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:10.111738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48a4c-83b4-440d-8993-12ea8138ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:10.112363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48a4c-83b4-440d-8993-12ea8138ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.112865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48a4c-83b4-440d-8993-12ea8138ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.113157 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48a4c-83b4-440d-8993-12ea8138ffd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.171135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 537/1041] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:28:10.186818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb48a4c-83b4-440d-8993-12ea8138ffd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:10.188520 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb48a4c-83b4-440d-8993-12ea8138ffd6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:10.307750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 505/1042] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:09 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:10.313596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9640049-4c6b-41dc-8645-90f901c41247 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:10.332319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:10.416461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9640049-4c6b-41dc-8645-90f901c41247 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:10.440419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48a4c-83b4-440d-8993-12ea8138ffd6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:10.453622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c51daf-3b4e-4cff-a408-5bb525252e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:10.454257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c51daf-3b4e-4cff-a408-5bb525252e5d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.454535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c51daf-3b4e-4cff-a408-5bb525252e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.454803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c51daf-3b4e-4cff-a408-5bb525252e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.457358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:10.466452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c51daf-3b4e-4cff-a408-5bb525252e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:10.470321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c51daf-3b4e-4cff-a408-5bb525252e5d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-48c51daf-3b4e-4cff-a408-5bb525252e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:28:10.483822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:10.484820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:28:10.486190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:28:10.486190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:10.486190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:10.486190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 538/1043] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:10.490460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c51daf-3b4e-4cff-a408-5bb525252e5d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:10.550225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48a4c-83b4-440d-8993-12ea8138ffd6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:10.566700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:10.587142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff2769-634a-40a6-9e9f-b14ae1932f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:10.587710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff2769-634a-40a6-9e9f-b14ae1932f54 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.587986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff2769-634a-40a6-9e9f-b14ae1932f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.588256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff2769-634a-40a6-9e9f-b14ae1932f54 None admin] PATH_INFO: `/v3/services/image` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.588844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff2769-634a-40a6-9e9f-b14ae1932f54 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:10.590204 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff2769-634a-40a6-9e9f-b14ae1932f54 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-8eff2769-634a-40a6-9e9f-b14ae1932f54 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:10.599449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:10.601561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:10.602571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 506/1044] 10.222.0.88 () {56 vars in 1105 bytes} [Wed Aug 24 03:28:10 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:28:10.607412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff2769-634a-40a6-9e9f-b14ae1932f54 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:10.613989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c51daf-3b4e-4cff-a408-5bb525252e5d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:10.647727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdec0a-c5b5-431f-8a2f-095c09fde03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:10.648334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdec0a-c5b5-431f-8a2f-095c09fde03f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.648617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdec0a-c5b5-431f-8a2f-095c09fde03f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.648895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdec0a-c5b5-431f-8a2f-095c09fde03f None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.649543 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdec0a-c5b5-431f-8a2f-095c09fde03f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:10.649855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdec0a-c5b5-431f-8a2f-095c09fde03f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:10.651261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdec0a-c5b5-431f-8a2f-095c09fde03f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:10.663506 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 539/1045] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:10.664789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758dad-b2ad-452d-9a89-c0f11950f769 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.665081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758dad-b2ad-452d-9a89-c0f11950f769 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.665358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758dad-b2ad-452d-9a89-c0f11950f769 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.666740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 540/1046] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:10.668830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758dad-b2ad-452d-9a89-c0f11950f769 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:10.692174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:10.717416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff2769-634a-40a6-9e9f-b14ae1932f54 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:10.752315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8af7a1-82d7-4b3f-8e93-bed3afe7bc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:10.752913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8af7a1-82d7-4b3f-8e93-bed3afe7bc7c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.753190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8af7a1-82d7-4b3f-8e93-bed3afe7bc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.753461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8af7a1-82d7-4b3f-8e93-bed3afe7bc7c None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.754086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8af7a1-82d7-4b3f-8e93-bed3afe7bc7c None admin] RBAC: Adding query filter params (name=image) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:10.754387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8af7a1-82d7-4b3f-8e93-bed3afe7bc7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:10.755790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8af7a1-82d7-4b3f-8e93-bed3afe7bc7c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:10.761225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 507/1047] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:10.762372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b923c3-eb57-4fed-af64-8ef75ec7199d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.762651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b923c3-eb57-4fed-af64-8ef75ec7199d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.762924 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b923c3-eb57-4fed-af64-8ef75ec7199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.772272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758dad-b2ad-452d-9a89-c0f11950f769 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:10.780100 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-56b923c3-eb57-4fed-af64-8ef75ec7199d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:10.781305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-56b923c3-eb57-4fed-af64-8ef75ec7199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:10.799212 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:10.807499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3711196-ff4f-4001-9f01-7bb296a90955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:10.808139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3711196-ff4f-4001-9f01-7bb296a90955 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.808673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3711196-ff4f-4001-9f01-7bb296a90955 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.808673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3711196-ff4f-4001-9f01-7bb296a90955 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.815218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3711196-ff4f-4001-9f01-7bb296a90955 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:10.816674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3711196-ff4f-4001-9f01-7bb296a90955 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a3711196-ff4f-4001-9f01-7bb296a90955 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:28:10.828923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:10.829835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:10.830757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:28:10.830757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:28:10.830757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:28:10.830757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:28:10.830757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:28:10.830757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:28:10.830757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:28:10.830757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:10.830757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 541/1048] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:28:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:28:10.831293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3711196-ff4f-4001-9f01-7bb296a90955 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:10.855798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 508/1049] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:10.856565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b923c3-eb57-4fed-af64-8ef75ec7199d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:10.927772 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:10.958662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b923c3-eb57-4fed-af64-8ef75ec7199d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:10.959395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3711196-ff4f-4001-9f01-7bb296a90955 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:10.995519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1501-67cc-4c7b-833f-512fdd3b568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:10.996131 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1501-67cc-4c7b-833f-512fdd3b568c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.996413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1501-67cc-4c7b-833f-512fdd3b568c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.996689 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1501-67cc-4c7b-833f-512fdd3b568c None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.997077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971c046-d40c-4465-8195-aad7b8529dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:10.997328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a1501-67cc-4c7b-833f-512fdd3b568c None admin] RBAC: Adding query filter params (type=image) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:10.997633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a1501-67cc-4c7b-833f-512fdd3b568c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:10.997727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c046-d40c-4465-8195-aad7b8529dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.997956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c046-d40c-4465-8195-aad7b8529dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.998232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971c046-d40c-4465-8195-aad7b8529dd2 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.998926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971c046-d40c-4465-8195-aad7b8529dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:10.999029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a1501-67cc-4c7b-833f-512fdd3b568c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:10.999279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971c046-d40c-4465-8195-aad7b8529dd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.000972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971c046-d40c-4465-8195-aad7b8529dd2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.003868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 542/1050] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:11.009904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1501-67cc-4c7b-833f-512fdd3b568c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.014782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 509/1051] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:11.020795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971c046-d40c-4465-8195-aad7b8529dd2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.066357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.118497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1501-67cc-4c7b-833f-512fdd3b568c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.132882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971c046-d40c-4465-8195-aad7b8529dd2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.153275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379e013-bc4c-48ed-b2ca-9fe7dbbfa5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.153889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379e013-bc4c-48ed-b2ca-9fe7dbbfa5ff None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.154173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379e013-bc4c-48ed-b2ca-9fe7dbbfa5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.154445 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379e013-bc4c-48ed-b2ca-9fe7dbbfa5ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.155132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379e013-bc4c-48ed-b2ca-9fe7dbbfa5ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.156518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379e013-bc4c-48ed-b2ca-9fe7dbbfa5ff None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.162345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.167811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272924e1-9566-40db-aab4-f22d3eabde89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.168417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272924e1-9566-40db-aab4-f22d3eabde89 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.168701 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272924e1-9566-40db-aab4-f22d3eabde89 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.168979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272924e1-9566-40db-aab4-f22d3eabde89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.173967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272924e1-9566-40db-aab4-f22d3eabde89 None admin] RBAC: Adding query filter params (role.id=984fb3415f2747f89ce2d5bcd6089515, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=9624bc4b2840420eb06d721a73655da4) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:11.173967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272924e1-9566-40db-aab4-f22d3eabde89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.173967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272924e1-9566-40db-aab4-f22d3eabde89 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.176808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 510/1052] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/role_assignments?user.id=9624bc4b2840420eb06d721a73655da4&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=984fb3415f2747f89ce2d5bcd6089515 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:11.177580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272924e1-9566-40db-aab4-f22d3eabde89 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.234596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 543/1053] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:28:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:11.317508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272924e1-9566-40db-aab4-f22d3eabde89 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.371784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385780f-d941-4411-8369-693d4da3fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.372343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385780f-d941-4411-8369-693d4da3fe21 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.372617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385780f-d941-4411-8369-693d4da3fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.372888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385780f-d941-4411-8369-693d4da3fe21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.384396 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385780f-d941-4411-8369-693d4da3fe21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-0385780f-d941-4411-8369-693d4da3fe21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:11.389135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:11.390117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:11.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:11.395693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 511/1054] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:11.396219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379e013-bc4c-48ed-b2ca-9fe7dbbfa5ff None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.507538 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379e013-bc4c-48ed-b2ca-9fe7dbbfa5ff None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.516929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.542141 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be858e3-55af-4fc5-855a-2cf5523b66bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.542747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be858e3-55af-4fc5-855a-2cf5523b66bb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.543026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be858e3-55af-4fc5-855a-2cf5523b66bb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.543325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be858e3-55af-4fc5-855a-2cf5523b66bb None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.543987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be858e3-55af-4fc5-855a-2cf5523b66bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:11.544289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be858e3-55af-4fc5-855a-2cf5523b66bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.545895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be858e3-55af-4fc5-855a-2cf5523b66bb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.555110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 544/1055] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:11.561156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385780f-d941-4411-8369-693d4da3fe21 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.629930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.692018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385780f-d941-4411-8369-693d4da3fe21 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.728136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e767-a4e2-46b5-ba11-91d56696da6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.729025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e767-a4e2-46b5-ba11-91d56696da6c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.729314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e767-a4e2-46b5-ba11-91d56696da6c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.729588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8e767-a4e2-46b5-ba11-91d56696da6c None admin] PATH_INFO: `/v3/users/070751fe2d69450e89d46f60f24a66cd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.743625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8e767-a4e2-46b5-ba11-91d56696da6c None admin] RBAC: Authorizing `identity:get_user(user_id=070751fe2d69450e89d46f60f24a66cd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.745084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8e767-a4e2-46b5-ba11-91d56696da6c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.751598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 512/1056] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/users/070751fe2d69450e89d46f60f24a66cd => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:11.752789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be858e3-55af-4fc5-855a-2cf5523b66bb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.861904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be858e3-55af-4fc5-855a-2cf5523b66bb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.901974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4d15-b9f9-4afc-acdd-bd1a9b3b992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.902515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4d15-b9f9-4afc-acdd-bd1a9b3b992b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.902792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4d15-b9f9-4afc-acdd-bd1a9b3b992b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.903077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4d15-b9f9-4afc-acdd-bd1a9b3b992b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.942522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.996433 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de4d15-b9f9-4afc-acdd-bd1a9b3b992b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.997914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de4d15-b9f9-4afc-acdd-bd1a9b3b992b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:12.099754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 545/1057] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:12.106204 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e767-a4e2-46b5-ba11-91d56696da6c None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:12.209645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8e767-a4e2-46b5-ba11-91d56696da6c None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:12.220709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:12.245330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804989f1-fdf2-4400-a539-9657ff1adf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:12.245961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804989f1-fdf2-4400-a539-9657ff1adf14 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:12.246239 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804989f1-fdf2-4400-a539-9657ff1adf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:12.246511 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804989f1-fdf2-4400-a539-9657ff1adf14 None admin] PATH_INFO: `/v3/projects/4ef5f1ea01a54edbb97c80a127171c25` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:12.247636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804989f1-fdf2-4400-a539-9657ff1adf14 None admin] RBAC: Authorizing `identity:get_project(project_id=4ef5f1ea01a54edbb97c80a127171c25)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:12.249138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804989f1-fdf2-4400-a539-9657ff1adf14 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:12.252245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 513/1058] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:12 2022] GET /identity/v3/projects/4ef5f1ea01a54edbb97c80a127171c25 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:12.257945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4d15-b9f9-4afc-acdd-bd1a9b3b992b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:12.338833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:12.370426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4d15-b9f9-4afc-acdd-bd1a9b3b992b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:12.405195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3a82a-c4cd-4b08-aa29-18c9bbb0d451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:12.405803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a82a-c4cd-4b08-aa29-18c9bbb0d451 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:12.406082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a82a-c4cd-4b08-aa29-18c9bbb0d451 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:12.406352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a82a-c4cd-4b08-aa29-18c9bbb0d451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:12.407143 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3a82a-c4cd-4b08-aa29-18c9bbb0d451 None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=4ef5f1ea01a54edbb97c80a127171c25, user.id=070751fe2d69450e89d46f60f24a66cd) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:12.407404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3a82a-c4cd-4b08-aa29-18c9bbb0d451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:12.408824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3a82a-c4cd-4b08-aa29-18c9bbb0d451 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:12.423077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 546/1059] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:12 2022] GET /identity/v3/role_assignments?user.id=070751fe2d69450e89d46f60f24a66cd&scope.project.id=4ef5f1ea01a54edbb97c80a127171c25&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:13.112725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa148f3-4d15-4861-b0c1-1965bac14394 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.113244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa148f3-4d15-4861-b0c1-1965bac14394 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.113322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa148f3-4d15-4861-b0c1-1965bac14394 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.114788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 514/1060] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:13.119933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c145e23-75b6-4781-9b6b-64a18de906be None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.120165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c145e23-75b6-4781-9b6b-64a18de906be None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.120443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c145e23-75b6-4781-9b6b-64a18de906be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.138999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3c145e23-75b6-4781-9b6b-64a18de906be None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:13.140213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3c145e23-75b6-4781-9b6b-64a18de906be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:13.207583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 547/1061] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:13.268456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08312f-9920-4574-b466-85dad7a7376f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.268772 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08312f-9920-4574-b466-85dad7a7376f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.269009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08312f-9920-4574-b466-85dad7a7376f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.270489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 515/1062] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:13.275635 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d66c4-6ab5-4ee3-a25d-27ed07eabbd4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.276066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d66c4-6ab5-4ee3-a25d-27ed07eabbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.276221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d66c4-6ab5-4ee3-a25d-27ed07eabbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.294855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5a9d66c4-6ab5-4ee3-a25d-27ed07eabbd4 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:13.296065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5a9d66c4-6ab5-4ee3-a25d-27ed07eabbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:13.357428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:13.366013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 548/1063] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:13.471802 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08312f-9920-4574-b466-85dad7a7376f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:13.588736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08312f-9920-4574-b466-85dad7a7376f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:13.623206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b7883-f976-4b4d-8209-058d709ae74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:13.623836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b7883-f976-4b4d-8209-058d709ae74d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.624117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b7883-f976-4b4d-8209-058d709ae74d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.624390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b7883-f976-4b4d-8209-058d709ae74d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.634632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b7883-f976-4b4d-8209-058d709ae74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:13.636101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d66c4-6ab5-4ee3-a25d-27ed07eabbd4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-6d9b7883-f976-4b4d-8209-058d709ae74d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:13.640638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:13.641564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:13.644010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 516/1064] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 03:28:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:13.651800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b7883-f976-4b4d-8209-058d709ae74d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:13.694956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:13.741688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d66c4-6ab5-4ee3-a25d-27ed07eabbd4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:13.761612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b7883-f976-4b4d-8209-058d709ae74d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:13.781121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe21c4-e47a-40aa-8251-7bb0801d5fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:13.781734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe21c4-e47a-40aa-8251-7bb0801d5fbf None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.782015 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe21c4-e47a-40aa-8251-7bb0801d5fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.782289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe21c4-e47a-40aa-8251-7bb0801d5fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.799995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cff27-4c77-4bd2-81bf-1f31d565bb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:13.800956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cff27-4c77-4bd2-81bf-1f31d565bb75 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.801402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cff27-4c77-4bd2-81bf-1f31d565bb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.801870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cff27-4c77-4bd2-81bf-1f31d565bb75 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.802713 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cff27-4c77-4bd2-81bf-1f31d565bb75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:13.803241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cff27-4c77-4bd2-81bf-1f31d565bb75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:13.804881 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cff27-4c77-4bd2-81bf-1f31d565bb75 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:13.814139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 517/1065] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 03:28:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:13.820576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cff27-4c77-4bd2-81bf-1f31d565bb75 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:13.854876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:13.861364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe21c4-e47a-40aa-8251-7bb0801d5fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:13.864931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe21c4-e47a-40aa-8251-7bb0801d5fbf None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:13.932508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:13.937284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cff27-4c77-4bd2-81bf-1f31d565bb75 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:13.974242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325657f-f63f-43d0-bbfd-482703814544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:13.975544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325657f-f63f-43d0-bbfd-482703814544 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.975834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325657f-f63f-43d0-bbfd-482703814544 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.976348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325657f-f63f-43d0-bbfd-482703814544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.981907 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 549/1066] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:13.987893 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe21c4-e47a-40aa-8251-7bb0801d5fbf None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:13.993687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325657f-f63f-43d0-bbfd-482703814544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:13.995115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325657f-f63f-43d0-bbfd-482703814544 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-d325657f-f63f-43d0-bbfd-482703814544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:28:14.011177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:14.012172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:28:14.013474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:28:14.013474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:14.013474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:14.013474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 518/1067] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:28:14.018052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325657f-f63f-43d0-bbfd-482703814544 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.096327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.102979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe21c4-e47a-40aa-8251-7bb0801d5fbf None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.134627 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325657f-f63f-43d0-bbfd-482703814544 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.149654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd4a9b-4f71-4331-8ba7-3ecd0481391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.151037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd4a9b-4f71-4331-8ba7-3ecd0481391b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.151752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd4a9b-4f71-4331-8ba7-3ecd0481391b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.152450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd4a9b-4f71-4331-8ba7-3ecd0481391b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.164772 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd4a9b-4f71-4331-8ba7-3ecd0481391b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.166264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd4a9b-4f71-4331-8ba7-3ecd0481391b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.171789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7858c-92cb-4fff-bc68-61f64b547795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.172407 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7858c-92cb-4fff-bc68-61f64b547795 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.172689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7858c-92cb-4fff-bc68-61f64b547795 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.172963 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7858c-92cb-4fff-bc68-61f64b547795 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.173629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7858c-92cb-4fff-bc68-61f64b547795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:14.173931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7858c-92cb-4fff-bc68-61f64b547795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.175373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7858c-92cb-4fff-bc68-61f64b547795 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4cfd4a9b-4f71-4331-8ba7-3ecd0481391b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:28:14.182896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:14.183949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:28:14.184924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:28:14.184924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:14.184924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:14.184924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 550/1068] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:28:14.189835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd4a9b-4f71-4331-8ba7-3ecd0481391b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.196628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 519/1069] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:14.197296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7858c-92cb-4fff-bc68-61f64b547795 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.212456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.306505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd4a9b-4f71-4331-8ba7-3ecd0481391b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.312827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7858c-92cb-4fff-bc68-61f64b547795 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.342854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838abaac-b796-4b4c-88da-74f764bbb566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.343518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838abaac-b796-4b4c-88da-74f764bbb566 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.343792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838abaac-b796-4b4c-88da-74f764bbb566 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.344070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838abaac-b796-4b4c-88da-74f764bbb566 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.344723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838abaac-b796-4b4c-88da-74f764bbb566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:14.345027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838abaac-b796-4b4c-88da-74f764bbb566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.346420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838abaac-b796-4b4c-88da-74f764bbb566 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.356500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70644664-ae17-4f18-8b05-0266e35bafa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.357154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644664-ae17-4f18-8b05-0266e35bafa1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.357436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644664-ae17-4f18-8b05-0266e35bafa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.357712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644664-ae17-4f18-8b05-0266e35bafa1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.360152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 551/1070] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:14.361422 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7f1ee-2769-4a84-bbc8-2b0de939b699 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.361708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7f1ee-2769-4a84-bbc8-2b0de939b699 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.361981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7f1ee-2769-4a84-bbc8-2b0de939b699 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.363424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 552/1071] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:14.365841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70644664-ae17-4f18-8b05-0266e35bafa1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.367482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70644664-ae17-4f18-8b05-0266e35bafa1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.369074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f650-c0e9-4fd4-9464-9aa46d359df9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.369542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f650-c0e9-4fd4-9464-9aa46d359df9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.369822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f650-c0e9-4fd4-9464-9aa46d359df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-70644664-ae17-4f18-8b05-0266e35bafa1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:28:14.381202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:14.382334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:14.383341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:14.383341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:14.383341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:28:14.383341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:28:14.383341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:28:14.383341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:28:14.383341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:28:14.383341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:28:14.383341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:28:14.383341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:14.383341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 520/1072] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:28:14.385945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.391531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1e72f650-c0e9-4fd4-9464-9aa46d359df9 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:14.392336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70644664-ae17-4f18-8b05-0266e35bafa1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.392808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1e72f650-c0e9-4fd4-9464-9aa46d359df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:14.474382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.495403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 553/1073] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:14.511001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70644664-ae17-4f18-8b05-0266e35bafa1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.553386 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403cac3-0bde-40d4-a9b6-6857efae23e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.554001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403cac3-0bde-40d4-a9b6-6857efae23e6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.554286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403cac3-0bde-40d4-a9b6-6857efae23e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.554565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403cac3-0bde-40d4-a9b6-6857efae23e6 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.555348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403cac3-0bde-40d4-a9b6-6857efae23e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:14.555663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403cac3-0bde-40d4-a9b6-6857efae23e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.557154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403cac3-0bde-40d4-a9b6-6857efae23e6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.580838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 521/1074] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:14.587108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72f650-c0e9-4fd4-9464-9aa46d359df9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.708540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72f650-c0e9-4fd4-9464-9aa46d359df9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.743672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d278409-e279-471f-9689-f94514fa811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.744287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d278409-e279-471f-9689-f94514fa811f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.744568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d278409-e279-471f-9689-f94514fa811f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.744839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d278409-e279-471f-9689-f94514fa811f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.747541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.755525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d278409-e279-471f-9689-f94514fa811f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.757523 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d278409-e279-471f-9689-f94514fa811f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-2d278409-e279-471f-9689-f94514fa811f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:28:14.772664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:14.773690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:28:14.774642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:28:14.774642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:14.774642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:14.774642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 554/1075] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:14.776499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403cac3-0bde-40d4-a9b6-6857efae23e6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.779851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d278409-e279-471f-9689-f94514fa811f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.882896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403cac3-0bde-40d4-a9b6-6857efae23e6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.886037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d278409-e279-471f-9689-f94514fa811f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.911639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.919469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb5111-65a7-47c3-a9c7-ff3c654e49ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.920103 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb5111-65a7-47c3-a9c7-ff3c654e49ac None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.927062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb5111-65a7-47c3-a9c7-ff3c654e49ac None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.927062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb5111-65a7-47c3-a9c7-ff3c654e49ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.927230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1961ae3-de0b-4f60-8845-7bee5fb7f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.927230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1961ae3-de0b-4f60-8845-7bee5fb7f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.927230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1961ae3-de0b-4f60-8845-7bee5fb7f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.927230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1961ae3-de0b-4f60-8845-7bee5fb7f8b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.927519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1961ae3-de0b-4f60-8845-7bee5fb7f8b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:14.927519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1961ae3-de0b-4f60-8845-7bee5fb7f8b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.928922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1961ae3-de0b-4f60-8845-7bee5fb7f8b0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.931383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb5111-65a7-47c3-a9c7-ff3c654e49ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-50bb5111-65a7-47c3-a9c7-ff3c654e49ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:14.936222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:14.937195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:14.938062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 522/1076] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:14.941859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 555/1077] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:14.943250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb5111-65a7-47c3-a9c7-ff3c654e49ac None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.947949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1961ae3-de0b-4f60-8845-7bee5fb7f8b0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.997476 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:15.050960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1961ae3-de0b-4f60-8845-7bee5fb7f8b0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:15.054801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb5111-65a7-47c3-a9c7-ff3c654e49ac None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:15.084882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672543-c8cc-41ee-b470-8f6cf567412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:15.085511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672543-c8cc-41ee-b470-8f6cf567412b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:15.085792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672543-c8cc-41ee-b470-8f6cf567412b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:15.086059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672543-c8cc-41ee-b470-8f6cf567412b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:15.088690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3642067-0522-4122-af79-747a780589e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:15.089291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3642067-0522-4122-af79-747a780589e7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:15.089577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3642067-0522-4122-af79-747a780589e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:15.089855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3642067-0522-4122-af79-747a780589e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:15.090521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3642067-0522-4122-af79-747a780589e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:15.090828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3642067-0522-4122-af79-747a780589e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:15.092248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3642067-0522-4122-af79-747a780589e7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:15.092735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672543-c8cc-41ee-b470-8f6cf567412b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:15.094697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672543-c8cc-41ee-b470-8f6cf567412b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:15.101164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 523/1078] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-f5672543-c8cc-41ee-b470-8f6cf567412b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:28:15.107003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:15.108094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:15.109038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:28:15.109038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:28:15.109038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:28:15.109038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:28:15.109038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:28:15.109038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:28:15.109038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:28:15.109038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:15.109489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3642067-0522-4122-af79-747a780589e7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:15.109569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 556/1079] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:15.113542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672543-c8cc-41ee-b470-8f6cf567412b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:15.159476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:15.205852 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3642067-0522-4122-af79-747a780589e7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:15.212071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672543-c8cc-41ee-b470-8f6cf567412b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:15.220984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:15.240540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3be582-cd25-4716-b4e4-7184d61a6588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:15.241177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3be582-cd25-4716-b4e4-7184d61a6588 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:15.241471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3be582-cd25-4716-b4e4-7184d61a6588 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:15.241776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3be582-cd25-4716-b4e4-7184d61a6588 None admin] PATH_INFO: `/v3/users/070751fe2d69450e89d46f60f24a66cd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:15.242922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3be582-cd25-4716-b4e4-7184d61a6588 None admin] RBAC: Authorizing `identity:get_user(user_id=070751fe2d69450e89d46f60f24a66cd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:15.244403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3be582-cd25-4716-b4e4-7184d61a6588 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:15.246003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 524/1080] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:15 2022] GET /identity/v3/users/070751fe2d69450e89d46f60f24a66cd => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:15.246161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d569-0b0c-4799-86bd-afe29d54fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:15.246776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d569-0b0c-4799-86bd-afe29d54fe27 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:15.247168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d569-0b0c-4799-86bd-afe29d54fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:15.247538 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876d569-0b0c-4799-86bd-afe29d54fe27 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:15.248247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876d569-0b0c-4799-86bd-afe29d54fe27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:15.248558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876d569-0b0c-4799-86bd-afe29d54fe27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:15.249993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876d569-0b0c-4799-86bd-afe29d54fe27 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:15.251769 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3be582-cd25-4716-b4e4-7184d61a6588 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:15.263557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 557/1081] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:28:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:15.269025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d569-0b0c-4799-86bd-afe29d54fe27 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:15.357343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3be582-cd25-4716-b4e4-7184d61a6588 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:15.371960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876d569-0b0c-4799-86bd-afe29d54fe27 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:15.376398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:15.391180 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cde111-fe10-4d74-a126-f8502707cf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:15.391811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cde111-fe10-4d74-a126-f8502707cf2e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:15.392094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cde111-fe10-4d74-a126-f8502707cf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:15.392369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cde111-fe10-4d74-a126-f8502707cf2e None admin] PATH_INFO: `/v3/projects/4ef5f1ea01a54edbb97c80a127171c25` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:15.393487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cde111-fe10-4d74-a126-f8502707cf2e None admin] RBAC: Authorizing `identity:get_project(project_id=4ef5f1ea01a54edbb97c80a127171c25)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:15.394921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cde111-fe10-4d74-a126-f8502707cf2e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:15.397176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 525/1082] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:15 2022] GET /identity/v3/projects/4ef5f1ea01a54edbb97c80a127171c25 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:15.403369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cde111-fe10-4d74-a126-f8502707cf2e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:15.406538 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af4f0e-dfa3-49e8-a6e7-c5b678365779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:15.407233 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af4f0e-dfa3-49e8-a6e7-c5b678365779 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:15.407544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af4f0e-dfa3-49e8-a6e7-c5b678365779 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:15.407820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af4f0e-dfa3-49e8-a6e7-c5b678365779 None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/9624bc4b2840420eb06d721a73655da4/roles/984fb3415f2747f89ce2d5bcd6089515` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:15.410060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af4f0e-dfa3-49e8-a6e7-c5b678365779 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=9624bc4b2840420eb06d721a73655da4, role_id=984fb3415f2747f89ce2d5bcd6089515)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:15.411482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af4f0e-dfa3-49e8-a6e7-c5b678365779 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:15.477363 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 558/1083] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:28:15 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/9624bc4b2840420eb06d721a73655da4/roles/984fb3415f2747f89ce2d5bcd6089515 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:28:15.503648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cde111-fe10-4d74-a126-f8502707cf2e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:15.542530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7b9f2-5f7d-4c99-aa3d-0abc371fd1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:15.543244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7b9f2-5f7d-4c99-aa3d-0abc371fd1d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:15.543526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7b9f2-5f7d-4c99-aa3d-0abc371fd1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:15.543801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7b9f2-5f7d-4c99-aa3d-0abc371fd1d0 None admin] PATH_INFO: `/v3/projects/4ef5f1ea01a54edbb97c80a127171c25/users/070751fe2d69450e89d46f60f24a66cd/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:15.545853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7b9f2-5f7d-4c99-aa3d-0abc371fd1d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ef5f1ea01a54edbb97c80a127171c25, user_id=070751fe2d69450e89d46f60f24a66cd, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:15.547351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7b9f2-5f7d-4c99-aa3d-0abc371fd1d0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:15.604206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 526/1084] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:28:15 2022] PUT /identity/v3/projects/4ef5f1ea01a54edbb97c80a127171c25/users/070751fe2d69450e89d46f60f24a66cd/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:28:17.390290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e16cd-b8ee-438c-8594-55b42f0bbc08 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.390853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e16cd-b8ee-438c-8594-55b42f0bbc08 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.390853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e16cd-b8ee-438c-8594-55b42f0bbc08 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.392358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 559/1085] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:17.397798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8cd5-4ebe-4d6a-8280-ce7b8d26b49e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.398182 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8cd5-4ebe-4d6a-8280-ce7b8d26b49e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.398472 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8cd5-4ebe-4d6a-8280-ce7b8d26b49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.416852 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-959c8cd5-4ebe-4d6a-8280-ce7b8d26b49e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:17.418044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-959c8cd5-4ebe-4d6a-8280-ce7b8d26b49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:17.462915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:17.487165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 527/1086] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:17.500755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28aa8c-11b8-43b5-a29c-7a02e43438e6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.501129 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28aa8c-11b8-43b5-a29c-7a02e43438e6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.501471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28aa8c-11b8-43b5-a29c-7a02e43438e6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.502886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 560/1087] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:17.508565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbc93d-6af2-45a3-911b-bc5760ca45a3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.508859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbc93d-6af2-45a3-911b-bc5760ca45a3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.509140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbc93d-6af2-45a3-911b-bc5760ca45a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.531112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-71cbc93d-6af2-45a3-911b-bc5760ca45a3 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:17.532333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-71cbc93d-6af2-45a3-911b-bc5760ca45a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:17.597882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 528/1088] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:17.759034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28aa8c-11b8-43b5-a29c-7a02e43438e6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:17.786830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:17.858941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28aa8c-11b8-43b5-a29c-7a02e43438e6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:17.866554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbc93d-6af2-45a3-911b-bc5760ca45a3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:17.893450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f0bdb-13b7-4367-bde8-853517bd7315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:17.894077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0bdb-13b7-4367-bde8-853517bd7315 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.894352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0bdb-13b7-4367-bde8-853517bd7315 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.894630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0bdb-13b7-4367-bde8-853517bd7315 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.905216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f0bdb-13b7-4367-bde8-853517bd7315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-065f0bdb-13b7-4367-bde8-853517bd7315 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:17.909877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:17.910872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:17.911918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 561/1089] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 03:28:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:17.916756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f0bdb-13b7-4367-bde8-853517bd7315 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:17.967159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbc93d-6af2-45a3-911b-bc5760ca45a3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:17.977028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:18.001657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2b98b-2b31-425a-89ea-f37ac71882c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.002287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2b98b-2b31-425a-89ea-f37ac71882c5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.002567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2b98b-2b31-425a-89ea-f37ac71882c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.002841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2b98b-2b31-425a-89ea-f37ac71882c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.008497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:18.012932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2b98b-2b31-425a-89ea-f37ac71882c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-e8d2b98b-2b31-425a-89ea-f37ac71882c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:18.017730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:18.018723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:18.019624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 529/1090] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:18.020485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f0bdb-13b7-4367-bde8-853517bd7315 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.025125 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2b98b-2b31-425a-89ea-f37ac71882c5 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.055747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac737f1-0192-46b5-972d-90395bc4cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.056353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac737f1-0192-46b5-972d-90395bc4cb03 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.056680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac737f1-0192-46b5-972d-90395bc4cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.056958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac737f1-0192-46b5-972d-90395bc4cb03 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.057626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac737f1-0192-46b5-972d-90395bc4cb03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:18.057936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac737f1-0192-46b5-972d-90395bc4cb03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.059351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac737f1-0192-46b5-972d-90395bc4cb03 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.067435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 562/1091] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 03:28:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:18.072942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac737f1-0192-46b5-972d-90395bc4cb03 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.126322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2b98b-2b31-425a-89ea-f37ac71882c5 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.163662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27ffd3-63e3-4ccb-b144-74d4f6353570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.164263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27ffd3-63e3-4ccb-b144-74d4f6353570 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.164551 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27ffd3-63e3-4ccb-b144-74d4f6353570 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.164822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27ffd3-63e3-4ccb-b144-74d4f6353570 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.165488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27ffd3-63e3-4ccb-b144-74d4f6353570 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:18.165793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27ffd3-63e3-4ccb-b144-74d4f6353570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.167272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27ffd3-63e3-4ccb-b144-74d4f6353570 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.171982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac737f1-0192-46b5-972d-90395bc4cb03 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.175500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 530/1092] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:18.181210 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27ffd3-63e3-4ccb-b144-74d4f6353570 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.206654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a26c-72c3-4028-a56c-6d4f32a7a8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.207328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a26c-72c3-4028-a56c-6d4f32a7a8bd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.207613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a26c-72c3-4028-a56c-6d4f32a7a8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.207889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a26c-72c3-4028-a56c-6d4f32a7a8bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.212043 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:18.219188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891a26c-72c3-4028-a56c-6d4f32a7a8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.220647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891a26c-72c3-4028-a56c-6d4f32a7a8bd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-4891a26c-72c3-4028-a56c-6d4f32a7a8bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:28:18.235552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:18.236753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:28:18.238055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:28:18.238055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:18.238055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:18.238055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 563/1093] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:28:18.242476 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a26c-72c3-4028-a56c-6d4f32a7a8bd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.245186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:18.286352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27ffd3-63e3-4ccb-b144-74d4f6353570 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.321278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cb8e2-e1ff-4309-90df-f664b9016462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.321886 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cb8e2-e1ff-4309-90df-f664b9016462 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.322173 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cb8e2-e1ff-4309-90df-f664b9016462 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.322444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cb8e2-e1ff-4309-90df-f664b9016462 None admin] PATH_INFO: `/v3/users/070751fe2d69450e89d46f60f24a66cd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.323616 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cb8e2-e1ff-4309-90df-f664b9016462 None admin] RBAC: Authorizing `identity:get_user(user_id=070751fe2d69450e89d46f60f24a66cd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.325069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cb8e2-e1ff-4309-90df-f664b9016462 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.326678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 531/1094] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:18 2022] GET /identity/v3/users/070751fe2d69450e89d46f60f24a66cd => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:18.332871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cb8e2-e1ff-4309-90df-f664b9016462 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.342316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a26c-72c3-4028-a56c-6d4f32a7a8bd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.376644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729215b8-686f-4bdd-ae60-f2701995df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.377255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729215b8-686f-4bdd-ae60-f2701995df70 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.377534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729215b8-686f-4bdd-ae60-f2701995df70 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.377808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729215b8-686f-4bdd-ae60-f2701995df70 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.378458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729215b8-686f-4bdd-ae60-f2701995df70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:18.378763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729215b8-686f-4bdd-ae60-f2701995df70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.380181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729215b8-686f-4bdd-ae60-f2701995df70 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.393144 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 564/1095] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:18.399506 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729215b8-686f-4bdd-ae60-f2701995df70 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.435426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:18.439223 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cb8e2-e1ff-4309-90df-f664b9016462 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.460810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:18.474249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f606-8bf2-407e-9b72-0a48f2bc0117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.474862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f606-8bf2-407e-9b72-0a48f2bc0117 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.475174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f606-8bf2-407e-9b72-0a48f2bc0117 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.475451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046f606-8bf2-407e-9b72-0a48f2bc0117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.498278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729215b8-686f-4bdd-ae60-f2701995df70 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.531780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f67804-e617-462d-b83e-04d3ce18cd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.532411 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f67804-e617-462d-b83e-04d3ce18cd14 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.532695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f67804-e617-462d-b83e-04d3ce18cd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.532972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f67804-e617-462d-b83e-04d3ce18cd14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.541099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f67804-e617-462d-b83e-04d3ce18cd14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.542492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f67804-e617-462d-b83e-04d3ce18cd14 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.542804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046f606-8bf2-407e-9b72-0a48f2bc0117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.544277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046f606-8bf2-407e-9b72-0a48f2bc0117 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-c2f67804-e617-462d-b83e-04d3ce18cd14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:28:18.554018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:18.554952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:18.556647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:18.556647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:18.556647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:28:18.556647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:28:18.556647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:28:18.556647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:28:18.556647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:28:18.556647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:28:18.556647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:28:18.556647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:18.556647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 565/1096] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 03:28:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:28:18.560805 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f67804-e617-462d-b83e-04d3ce18cd14 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.638397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:18.643091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 532/1097] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:28:18.649426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f606-8bf2-407e-9b72-0a48f2bc0117 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.660804 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f67804-e617-462d-b83e-04d3ce18cd14 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.683725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:18.695374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a25bb-c30a-46a8-9e37-2303fbdc3df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.698824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a25bb-c30a-46a8-9e37-2303fbdc3df5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.698824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a25bb-c30a-46a8-9e37-2303fbdc3df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.698824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a25bb-c30a-46a8-9e37-2303fbdc3df5 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.698824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a25bb-c30a-46a8-9e37-2303fbdc3df5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:18.698824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a25bb-c30a-46a8-9e37-2303fbdc3df5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.699240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a25bb-c30a-46a8-9e37-2303fbdc3df5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.721211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 566/1098] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 03:28:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:18.722587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a25bb-c30a-46a8-9e37-2303fbdc3df5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.748730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046f606-8bf2-407e-9b72-0a48f2bc0117 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.786737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca36cb-182c-425d-8ff4-17a4e0c50eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.788033 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca36cb-182c-425d-8ff4-17a4e0c50eef None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.788308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca36cb-182c-425d-8ff4-17a4e0c50eef None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.788577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca36cb-182c-425d-8ff4-17a4e0c50eef None admin] PATH_INFO: `/v3/projects/4ef5f1ea01a54edbb97c80a127171c25` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.789688 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca36cb-182c-425d-8ff4-17a4e0c50eef None admin] RBAC: Authorizing `identity:get_project(project_id=4ef5f1ea01a54edbb97c80a127171c25)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.791218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca36cb-182c-425d-8ff4-17a4e0c50eef None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.792774 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 533/1099] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:18 2022] GET /identity/v3/projects/4ef5f1ea01a54edbb97c80a127171c25 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:18.798678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca36cb-182c-425d-8ff4-17a4e0c50eef None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.822653 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a25bb-c30a-46a8-9e37-2303fbdc3df5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.857906 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e77b3a-7e79-4f6f-8e6a-fb0396660cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.858514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77b3a-7e79-4f6f-8e6a-fb0396660cfe None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.858795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77b3a-7e79-4f6f-8e6a-fb0396660cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.859088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e77b3a-7e79-4f6f-8e6a-fb0396660cfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.863597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:18.900337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca36cb-182c-425d-8ff4-17a4e0c50eef None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.911617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:18.931038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e77b3a-7e79-4f6f-8e6a-fb0396660cfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.932552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e77b3a-7e79-4f6f-8e6a-fb0396660cfe None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.937686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12389fc8-ecbf-4287-9220-d348a92b99f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.938294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12389fc8-ecbf-4287-9220-d348a92b99f7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.938579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12389fc8-ecbf-4287-9220-d348a92b99f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.938857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12389fc8-ecbf-4287-9220-d348a92b99f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.939675 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12389fc8-ecbf-4287-9220-d348a92b99f7 None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=4ef5f1ea01a54edbb97c80a127171c25, user.id=070751fe2d69450e89d46f60f24a66cd) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:18.939987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12389fc8-ecbf-4287-9220-d348a92b99f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.941416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12389fc8-ecbf-4287-9220-d348a92b99f7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.947399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 534/1100] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:18 2022] GET /identity/v3/role_assignments?user.id=070751fe2d69450e89d46f60f24a66cd&scope.project.id=4ef5f1ea01a54edbb97c80a127171c25&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:19.042227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 567/1101] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:19.048221 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12389fc8-ecbf-4287-9220-d348a92b99f7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:19.152185 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12389fc8-ecbf-4287-9220-d348a92b99f7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:19.181055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:19.186848 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf930d6-06d9-4e48-b300-df17f995b7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:19.192313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf930d6-06d9-4e48-b300-df17f995b7cc None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:19.192313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf930d6-06d9-4e48-b300-df17f995b7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:19.192313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf930d6-06d9-4e48-b300-df17f995b7cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:19.198568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf930d6-06d9-4e48-b300-df17f995b7cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:19.200051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf930d6-06d9-4e48-b300-df17f995b7cc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-ddf930d6-06d9-4e48-b300-df17f995b7cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:28:19.216739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:19.218092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:28:19.219284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:28:19.219284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:28:19.219284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:19.219284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 535/1102] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:19.225173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e77b3a-7e79-4f6f-8e6a-fb0396660cfe None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:19.309859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:19.328669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e77b3a-7e79-4f6f-8e6a-fb0396660cfe None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:19.369026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c65ac-251d-47c2-8b8f-d2e4bce227c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:19.369635 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c65ac-251d-47c2-8b8f-d2e4bce227c4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:19.369916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c65ac-251d-47c2-8b8f-d2e4bce227c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:19.370189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c65ac-251d-47c2-8b8f-d2e4bce227c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:19.370832 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c65ac-251d-47c2-8b8f-d2e4bce227c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:19.371170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c65ac-251d-47c2-8b8f-d2e4bce227c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:19.372544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c65ac-251d-47c2-8b8f-d2e4bce227c4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:19.383874 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 568/1103] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:19.389491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf930d6-06d9-4e48-b300-df17f995b7cc None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:19.491191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf930d6-06d9-4e48-b300-df17f995b7cc None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:19.524389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58586f99-39ce-4efc-8583-8396603f65e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:19.525019 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58586f99-39ce-4efc-8583-8396603f65e2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:19.525298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58586f99-39ce-4efc-8583-8396603f65e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:19.525568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58586f99-39ce-4efc-8583-8396603f65e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:19.532380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58586f99-39ce-4efc-8583-8396603f65e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:19.533831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58586f99-39ce-4efc-8583-8396603f65e2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-58586f99-39ce-4efc-8583-8396603f65e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:28:19.545587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:19.546632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:19.547663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:28:19.547663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:28:19.547663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:28:19.547663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:28:19.547663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:28:19.547663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:28:19.547663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:28:19.547663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:19.547663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 536/1104] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:19.552884 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c65ac-251d-47c2-8b8f-d2e4bce227c4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:19.651913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c65ac-251d-47c2-8b8f-d2e4bce227c4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:19.686103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7029e1e-9044-407d-b7aa-3e2dd9a108b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:19.687170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7029e1e-9044-407d-b7aa-3e2dd9a108b9 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:19.687660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7029e1e-9044-407d-b7aa-3e2dd9a108b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:19.688132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7029e1e-9044-407d-b7aa-3e2dd9a108b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:19.689404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7029e1e-9044-407d-b7aa-3e2dd9a108b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:19.689942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7029e1e-9044-407d-b7aa-3e2dd9a108b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:19.692612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7029e1e-9044-407d-b7aa-3e2dd9a108b9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:19.703351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:19.707466 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 569/1105] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:19.714062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58586f99-39ce-4efc-8583-8396603f65e2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:19.758002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:19.813944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58586f99-39ce-4efc-8583-8396603f65e2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:19.848356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceea40-ce34-4e43-a342-a8f7c64119b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:19.848967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceea40-ce34-4e43-a342-a8f7c64119b2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:19.849267 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceea40-ce34-4e43-a342-a8f7c64119b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:19.849554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceea40-ce34-4e43-a342-a8f7c64119b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:19.850291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbceea40-ce34-4e43-a342-a8f7c64119b2 None admin] RBAC: Adding query filter params (role.id=984fb3415f2747f89ce2d5bcd6089515, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=9624bc4b2840420eb06d721a73655da4) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:19.850603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbceea40-ce34-4e43-a342-a8f7c64119b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:19.852064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbceea40-ce34-4e43-a342-a8f7c64119b2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:19.858410 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 537/1106] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:19 2022] GET /identity/v3/role_assignments?user.id=9624bc4b2840420eb06d721a73655da4&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=984fb3415f2747f89ce2d5bcd6089515 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:20.897207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceede0b-299c-47ea-b64b-6b640210ae41 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:20.897736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceede0b-299c-47ea-b64b-6b640210ae41 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:20.897736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceede0b-299c-47ea-b64b-6b640210ae41 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:20.899142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 570/1107] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:20.904898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a138f-d8b6-4cb3-966c-ed7d4b747ae6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:20.905351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a138f-d8b6-4cb3-966c-ed7d4b747ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:20.906084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a138f-d8b6-4cb3-966c-ed7d4b747ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:20.924810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-748a138f-d8b6-4cb3-966c-ed7d4b747ae6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:20.926073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-748a138f-d8b6-4cb3-966c-ed7d4b747ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:20.993237 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 538/1108] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:21.261031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceede0b-299c-47ea-b64b-6b640210ae41 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:21.362415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceede0b-299c-47ea-b64b-6b640210ae41 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:21.395692 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895873-e59e-4719-8e67-d742fb560321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:21.396305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895873-e59e-4719-8e67-d742fb560321 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:21.396580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895873-e59e-4719-8e67-d742fb560321 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:21.396846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895873-e59e-4719-8e67-d742fb560321 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:21.397940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895873-e59e-4719-8e67-d742fb560321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:21.399393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895873-e59e-4719-8e67-d742fb560321 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:21.400939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 571/1109] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:21.406730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a138f-d8b6-4cb3-966c-ed7d4b747ae6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:21.441436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:21.505348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a138f-d8b6-4cb3-966c-ed7d4b747ae6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:21.540730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820424d-829c-47df-92da-e7e072d6f63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:21.541273 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820424d-829c-47df-92da-e7e072d6f63e None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:21.541695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820424d-829c-47df-92da-e7e072d6f63e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:21.541976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820424d-829c-47df-92da-e7e072d6f63e None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:21.543597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820424d-829c-47df-92da-e7e072d6f63e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:21.545218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820424d-829c-47df-92da-e7e072d6f63e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:21.636831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 539/1110] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:28:21 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:28:23.587748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59461c-bd74-4207-bb36-6478bff8d6c3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:23.588282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59461c-bd74-4207-bb36-6478bff8d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:23.588282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59461c-bd74-4207-bb36-6478bff8d6c3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:23.589645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 572/1111] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:23.595171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e489a78-bb88-44ac-b265-9222de3600e8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:23.595576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e489a78-bb88-44ac-b265-9222de3600e8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:23.595732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e489a78-bb88-44ac-b265-9222de3600e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:23.614271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2e489a78-bb88-44ac-b265-9222de3600e8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:23.616108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2e489a78-bb88-44ac-b265-9222de3600e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:23.680840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 540/1112] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:23.953667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59461c-bd74-4207-bb36-6478bff8d6c3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:24.020634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:24.055739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59461c-bd74-4207-bb36-6478bff8d6c3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:24.090567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080efab-9f26-47ce-a60e-5838a61b1985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:24.091233 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080efab-9f26-47ce-a60e-5838a61b1985 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:24.091517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080efab-9f26-47ce-a60e-5838a61b1985 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:24.091790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080efab-9f26-47ce-a60e-5838a61b1985 None admin] PATH_INFO: `/v3/roles/0abc70600d6f4948a59e9a14d33aa289` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:24.093174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080efab-9f26-47ce-a60e-5838a61b1985 None admin] RBAC: Authorizing `identity:get_role(role_id=0abc70600d6f4948a59e9a14d33aa289)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:24.094549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080efab-9f26-47ce-a60e-5838a61b1985 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:24.095957 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 573/1113] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:23 2022] GET /identity/v3/roles/0abc70600d6f4948a59e9a14d33aa289 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:24.102460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e489a78-bb88-44ac-b265-9222de3600e8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:24.128598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:24.203339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e489a78-bb88-44ac-b265-9222de3600e8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:24.237827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46def25a-29c8-4a38-b6e4-a205d15e32de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:24.238444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46def25a-29c8-4a38-b6e4-a205d15e32de None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:24.238722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46def25a-29c8-4a38-b6e4-a205d15e32de None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:24.238992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46def25a-29c8-4a38-b6e4-a205d15e32de None admin] PATH_INFO: `/v3/users/5ed702baaafc40d994b466e4500d22d3` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:24.251910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46def25a-29c8-4a38-b6e4-a205d15e32de None admin] RBAC: Authorizing `identity:get_user(user_id=5ed702baaafc40d994b466e4500d22d3)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:24.253345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46def25a-29c8-4a38-b6e4-a205d15e32de None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:24.254937 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 541/1114] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:24 2022] GET /identity/v3/users/5ed702baaafc40d994b466e4500d22d3 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:24.261519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080efab-9f26-47ce-a60e-5838a61b1985 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:24.359467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080efab-9f26-47ce-a60e-5838a61b1985 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:24.392611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a95138-ceef-4d5f-b0bb-b65b0fba86eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:24.393151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95138-ceef-4d5f-b0bb-b65b0fba86eb None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:24.393452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95138-ceef-4d5f-b0bb-b65b0fba86eb None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:24.393706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95138-ceef-4d5f-b0bb-b65b0fba86eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:24.397599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:24.461416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a95138-ceef-4d5f-b0bb-b65b0fba86eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:24.462879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a95138-ceef-4d5f-b0bb-b65b0fba86eb None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:24.557647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 574/1115] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:24.563778 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46def25a-29c8-4a38-b6e4-a205d15e32de None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:24.643135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:24.661603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46def25a-29c8-4a38-b6e4-a205d15e32de None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:24.695633 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6e64e-a9e0-4a89-a28f-5266406dd0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:24.696255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6e64e-a9e0-4a89-a28f-5266406dd0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:24.696539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6e64e-a9e0-4a89-a28f-5266406dd0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:24.696816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6e64e-a9e0-4a89-a28f-5266406dd0a5 None admin] PATH_INFO: `/v3/projects/4ef5f1ea01a54edbb97c80a127171c25` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:24.697931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6e64e-a9e0-4a89-a28f-5266406dd0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4ef5f1ea01a54edbb97c80a127171c25)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:24.699404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6e64e-a9e0-4a89-a28f-5266406dd0a5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:24.701024 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 542/1116] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:24 2022] GET /identity/v3/projects/4ef5f1ea01a54edbb97c80a127171c25 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:24.707395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a95138-ceef-4d5f-b0bb-b65b0fba86eb None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:24.741702 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:24.805280 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a95138-ceef-4d5f-b0bb-b65b0fba86eb None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:24.838581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b851c-7bf2-4392-a8c2-393f127bf963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:24.839220 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b851c-7bf2-4392-a8c2-393f127bf963 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:24.839502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b851c-7bf2-4392-a8c2-393f127bf963 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:24.839787 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b851c-7bf2-4392-a8c2-393f127bf963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:24.840518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b851c-7bf2-4392-a8c2-393f127bf963 None admin] RBAC: Adding query filter params (role.id=0abc70600d6f4948a59e9a14d33aa289, scope.project.id=4ef5f1ea01a54edbb97c80a127171c25, user.id=5ed702baaafc40d994b466e4500d22d3) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:24.840831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b851c-7bf2-4392-a8c2-393f127bf963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:24.842272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b851c-7bf2-4392-a8c2-393f127bf963 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:24.847739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 575/1117] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:24 2022] GET /identity/v3/role_assignments?user.id=5ed702baaafc40d994b466e4500d22d3&scope.project.id=4ef5f1ea01a54edbb97c80a127171c25&role.id=0abc70600d6f4948a59e9a14d33aa289 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:26.697257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b9f3-9753-487c-ac39-85f6cce32c7b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:26.697833 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b9f3-9753-487c-ac39-85f6cce32c7b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:26.697833 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b9f3-9753-487c-ac39-85f6cce32c7b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:26.699186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 543/1118] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:26.704347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b9249-6f00-420e-9c6b-cd0f42930713 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:26.704776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b9249-6f00-420e-9c6b-cd0f42930713 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:26.704882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b9249-6f00-420e-9c6b-cd0f42930713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:26.723100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b92b9249-6f00-420e-9c6b-cd0f42930713 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:26.724326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b92b9249-6f00-420e-9c6b-cd0f42930713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:26.789096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 576/1119] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:28:27.066265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7b9f3-9753-487c-ac39-85f6cce32c7b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:27.170863 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7b9f3-9753-487c-ac39-85f6cce32c7b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:27.204478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68a0cb-49c9-44df-9dae-76b99c20037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:27.205096 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68a0cb-49c9-44df-9dae-76b99c20037f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:27.205372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68a0cb-49c9-44df-9dae-76b99c20037f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:27.205641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68a0cb-49c9-44df-9dae-76b99c20037f None admin] PATH_INFO: `/v3/roles/0abc70600d6f4948a59e9a14d33aa289` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:27.207013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68a0cb-49c9-44df-9dae-76b99c20037f None admin] RBAC: Authorizing `identity:get_role(role_id=0abc70600d6f4948a59e9a14d33aa289)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:27.208422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68a0cb-49c9-44df-9dae-76b99c20037f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:27.209748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 544/1120] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:27 2022] GET /identity/v3/roles/0abc70600d6f4948a59e9a14d33aa289 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:27.215664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b9249-6f00-420e-9c6b-cd0f42930713 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:27.244877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:27.312358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b9249-6f00-420e-9c6b-cd0f42930713 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:27.345010 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe195b05-dfd8-4562-b32a-917464458c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:27.345571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe195b05-dfd8-4562-b32a-917464458c5b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:27.345849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe195b05-dfd8-4562-b32a-917464458c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:27.346208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe195b05-dfd8-4562-b32a-917464458c5b None admin] PATH_INFO: `/v3/users/5ed702baaafc40d994b466e4500d22d3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:27.347247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe195b05-dfd8-4562-b32a-917464458c5b None admin] RBAC: Authorizing `identity:get_user(user_id=5ed702baaafc40d994b466e4500d22d3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:27.348670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe195b05-dfd8-4562-b32a-917464458c5b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:27.350784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 577/1121] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:27 2022] GET /identity/v3/users/5ed702baaafc40d994b466e4500d22d3 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:27.356951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68a0cb-49c9-44df-9dae-76b99c20037f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:27.375804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:27.455631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68a0cb-49c9-44df-9dae-76b99c20037f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:27.492596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dbaba-8962-4bde-a2c8-7d6ab010c17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:27.493223 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dbaba-8962-4bde-a2c8-7d6ab010c17d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:27.493598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dbaba-8962-4bde-a2c8-7d6ab010c17d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:27.494098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dbaba-8962-4bde-a2c8-7d6ab010c17d None admin] PATH_INFO: `/v3/projects/4ef5f1ea01a54edbb97c80a127171c25` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:27.496055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dbaba-8962-4bde-a2c8-7d6ab010c17d None admin] RBAC: Authorizing `identity:get_project(project_id=4ef5f1ea01a54edbb97c80a127171c25)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:27.497808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dbaba-8962-4bde-a2c8-7d6ab010c17d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:27.499646 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 545/1122] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:27 2022] GET /identity/v3/projects/4ef5f1ea01a54edbb97c80a127171c25 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:27.505674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe195b05-dfd8-4562-b32a-917464458c5b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:27.602357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:27.606339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe195b05-dfd8-4562-b32a-917464458c5b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:27.639658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63185-7993-47a8-bcb4-ebcd99ff6ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:27.640303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63185-7993-47a8-bcb4-ebcd99ff6ea0 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:27.640585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63185-7993-47a8-bcb4-ebcd99ff6ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:27.640858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63185-7993-47a8-bcb4-ebcd99ff6ea0 None admin] PATH_INFO: `/v3/projects/4ef5f1ea01a54edbb97c80a127171c25/users/5ed702baaafc40d994b466e4500d22d3/roles/0abc70600d6f4948a59e9a14d33aa289` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:27.643011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f63185-7993-47a8-bcb4-ebcd99ff6ea0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ef5f1ea01a54edbb97c80a127171c25, user_id=5ed702baaafc40d994b466e4500d22d3, role_id=0abc70600d6f4948a59e9a14d33aa289)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:27.644485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f63185-7993-47a8-bcb4-ebcd99ff6ea0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:27.693683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 578/1123] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:28:27 2022] PUT /identity/v3/projects/4ef5f1ea01a54edbb97c80a127171c25/users/5ed702baaafc40d994b466e4500d22d3/roles/0abc70600d6f4948a59e9a14d33aa289 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:28:29.625664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3597ab-b47a-4940-bb99-4ea23450ca04 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:29.626238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3597ab-b47a-4940-bb99-4ea23450ca04 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:29.626238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3597ab-b47a-4940-bb99-4ea23450ca04 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:29.627632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 546/1124] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:29.633368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090302f-2fe9-46c3-a23e-23f1edb325f5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:29.633801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090302f-2fe9-46c3-a23e-23f1edb325f5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:29.633919 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090302f-2fe9-46c3-a23e-23f1edb325f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:29.652495 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6090302f-2fe9-46c3-a23e-23f1edb325f5 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:29.653690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6090302f-2fe9-46c3-a23e-23f1edb325f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:29.737789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 579/1125] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:28:30.014358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3597ab-b47a-4940-bb99-4ea23450ca04 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:30.106699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:30.123586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3597ab-b47a-4940-bb99-4ea23450ca04 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:30.168230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47455-b6b6-4b46-9492-a520749e9660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:30.168760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47455-b6b6-4b46-9492-a520749e9660 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.169044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47455-b6b6-4b46-9492-a520749e9660 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.169321 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47455-b6b6-4b46-9492-a520749e9660 None admin] PATH_INFO: `/v3/roles/0abc70600d6f4948a59e9a14d33aa289` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.170747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc47455-b6b6-4b46-9492-a520749e9660 None admin] RBAC: Authorizing `identity:get_role(role_id=0abc70600d6f4948a59e9a14d33aa289)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:30.172159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc47455-b6b6-4b46-9492-a520749e9660 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:30.173510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 547/1126] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:30 2022] GET /identity/v3/roles/0abc70600d6f4948a59e9a14d33aa289 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:30.179513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090302f-2fe9-46c3-a23e-23f1edb325f5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:30.267412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:30.282337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090302f-2fe9-46c3-a23e-23f1edb325f5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:30.325375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381578b-9a2e-4127-bc8b-3dfc1e5979e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:30.326007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381578b-9a2e-4127-bc8b-3dfc1e5979e8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.326291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381578b-9a2e-4127-bc8b-3dfc1e5979e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.326568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381578b-9a2e-4127-bc8b-3dfc1e5979e8 None admin] PATH_INFO: `/v3/users/5ed702baaafc40d994b466e4500d22d3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.327740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381578b-9a2e-4127-bc8b-3dfc1e5979e8 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed702baaafc40d994b466e4500d22d3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:30.329191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381578b-9a2e-4127-bc8b-3dfc1e5979e8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:30.330812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 580/1127] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:30 2022] GET /identity/v3/users/5ed702baaafc40d994b466e4500d22d3 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:30.337386 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47455-b6b6-4b46-9492-a520749e9660 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:30.439932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47455-b6b6-4b46-9492-a520749e9660 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:30.476218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a354bd7-1705-49f9-bdfb-baa50a52ef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:30.476826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a354bd7-1705-49f9-bdfb-baa50a52ef04 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.477102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a354bd7-1705-49f9-bdfb-baa50a52ef04 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.477373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a354bd7-1705-49f9-bdfb-baa50a52ef04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.506565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:30.561006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a354bd7-1705-49f9-bdfb-baa50a52ef04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:30.562376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a354bd7-1705-49f9-bdfb-baa50a52ef04 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:30.662431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 548/1128] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:30.668444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381578b-9a2e-4127-bc8b-3dfc1e5979e8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:30.764408 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381578b-9a2e-4127-bc8b-3dfc1e5979e8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:30.797251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc47a89-e337-4260-b129-6205e444a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:30.797867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc47a89-e337-4260-b129-6205e444a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.798145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc47a89-e337-4260-b129-6205e444a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.798413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc47a89-e337-4260-b129-6205e444a2c5 None admin] PATH_INFO: `/v3/projects/4ef5f1ea01a54edbb97c80a127171c25` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.799543 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc47a89-e337-4260-b129-6205e444a2c5 None admin] RBAC: Authorizing `identity:get_project(project_id=4ef5f1ea01a54edbb97c80a127171c25)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:30.800981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc47a89-e337-4260-b129-6205e444a2c5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:30.803161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 581/1129] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:30 2022] GET /identity/v3/projects/4ef5f1ea01a54edbb97c80a127171c25 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:30.809497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a354bd7-1705-49f9-bdfb-baa50a52ef04 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:30.866576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:30.911884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a354bd7-1705-49f9-bdfb-baa50a52ef04 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:30.945536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb836e-557b-4297-bf9f-8524e9099cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:30.946134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb836e-557b-4297-bf9f-8524e9099cbb None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.946415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb836e-557b-4297-bf9f-8524e9099cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.946688 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb836e-557b-4297-bf9f-8524e9099cbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.947447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb836e-557b-4297-bf9f-8524e9099cbb None admin] RBAC: Adding query filter params (role.id=0abc70600d6f4948a59e9a14d33aa289, scope.project.id=4ef5f1ea01a54edbb97c80a127171c25, user.id=5ed702baaafc40d994b466e4500d22d3) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:30.947760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb836e-557b-4297-bf9f-8524e9099cbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:30.949189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb836e-557b-4297-bf9f-8524e9099cbb None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:30.954835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 549/1130] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:30 2022] GET /identity/v3/role_assignments?user.id=5ed702baaafc40d994b466e4500d22d3&scope.project.id=4ef5f1ea01a54edbb97c80a127171c25&role.id=0abc70600d6f4948a59e9a14d33aa289 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:32.864082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a543226-3c5b-4490-96a3-8cfbb5673348 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:32.865177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a543226-3c5b-4490-96a3-8cfbb5673348 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:32.865177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a543226-3c5b-4490-96a3-8cfbb5673348 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:32.866541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 582/1131] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:32.872022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38202a-3552-434c-a191-49a50960b2a8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:32.872470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38202a-3552-434c-a191-49a50960b2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:32.872571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38202a-3552-434c-a191-49a50960b2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:32.890290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ae38202a-3552-434c-a191-49a50960b2a8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:32.891532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ae38202a-3552-434c-a191-49a50960b2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:32.955878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 550/1132] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:33.232254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a543226-3c5b-4490-96a3-8cfbb5673348 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:33.271732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:33.386527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a543226-3c5b-4490-96a3-8cfbb5673348 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:33.434500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ab30-0240-492b-a8f7-14a2f355e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:33.435166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ab30-0240-492b-a8f7-14a2f355e47a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:33.435450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ab30-0240-492b-a8f7-14a2f355e47a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:33.435721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ab30-0240-492b-a8f7-14a2f355e47a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:33.436852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751ab30-0240-492b-a8f7-14a2f355e47a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:33.438438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751ab30-0240-492b-a8f7-14a2f355e47a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:33.440810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 583/1133] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:33.446691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38202a-3552-434c-a191-49a50960b2a8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:33.496156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:33.556509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38202a-3552-434c-a191-49a50960b2a8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:33.596464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0eba8-ce5f-4e21-a627-ea09e09e15b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:33.597098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0eba8-ce5f-4e21-a627-ea09e09e15b5 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:33.597370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0eba8-ce5f-4e21-a627-ea09e09e15b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:33.597827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0eba8-ce5f-4e21-a627-ea09e09e15b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:33.598662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0eba8-ce5f-4e21-a627-ea09e09e15b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:33.600278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0eba8-ce5f-4e21-a627-ea09e09e15b5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:33.672885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 551/1134] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:28:33 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:35.599608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2d2c-5b56-4a07-9080-e5a9b0278844 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:35.600175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2d2c-5b56-4a07-9080-e5a9b0278844 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:35.600175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2d2c-5b56-4a07-9080-e5a9b0278844 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:35.601585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 584/1135] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:35.607039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa99dc-6aee-43b9-bf2d-7734d6ca5cb5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:35.607492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa99dc-6aee-43b9-bf2d-7734d6ca5cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:35.607617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa99dc-6aee-43b9-bf2d-7734d6ca5cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:35.625498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-edaa99dc-6aee-43b9-bf2d-7734d6ca5cb5 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:35.626685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-edaa99dc-6aee-43b9-bf2d-7734d6ca5cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:35.695642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 552/1136] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:35.964058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f2d2c-5b56-4a07-9080-e5a9b0278844 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:36.056767 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:36.065973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f2d2c-5b56-4a07-9080-e5a9b0278844 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:36.098531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759ef8b-5fa1-46f9-866c-c01478cd7b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:36.101041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759ef8b-5fa1-46f9-866c-c01478cd7b2f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:36.101041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759ef8b-5fa1-46f9-866c-c01478cd7b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:36.101041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759ef8b-5fa1-46f9-866c-c01478cd7b2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:36.101041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759ef8b-5fa1-46f9-866c-c01478cd7b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:36.102238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759ef8b-5fa1-46f9-866c-c01478cd7b2f None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:36.104132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 585/1137] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:36.110167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa99dc-6aee-43b9-bf2d-7734d6ca5cb5 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:36.138300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:36.206566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa99dc-6aee-43b9-bf2d-7734d6ca5cb5 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:36.238875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b20a7-eeb7-4746-9cde-ad50c0345a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:36.241844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b20a7-eeb7-4746-9cde-ad50c0345a33 None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:36.242122 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b20a7-eeb7-4746-9cde-ad50c0345a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:36.242393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b20a7-eeb7-4746-9cde-ad50c0345a33 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:36.243063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b20a7-eeb7-4746-9cde-ad50c0345a33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:36.244500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b20a7-eeb7-4746-9cde-ad50c0345a33 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:36.327872 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 553/1138] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:28:36 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:38.250817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2361955-c6c9-48fa-b33a-3ad88c378290 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:38.251373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2361955-c6c9-48fa-b33a-3ad88c378290 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:38.251373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2361955-c6c9-48fa-b33a-3ad88c378290 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:38.252745 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 586/1139] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:38.257861 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880aaa9c-79f6-4159-ab44-29f0cb959431 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:38.258294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880aaa9c-79f6-4159-ab44-29f0cb959431 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:38.258419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880aaa9c-79f6-4159-ab44-29f0cb959431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:38.276941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-880aaa9c-79f6-4159-ab44-29f0cb959431 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:38.278155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-880aaa9c-79f6-4159-ab44-29f0cb959431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:38.343305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 554/1140] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:38.612871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2361955-c6c9-48fa-b33a-3ad88c378290 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:38.711963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2361955-c6c9-48fa-b33a-3ad88c378290 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:38.745457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb21f7-24e3-476e-9e87-5ae5cbd441a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:38.746079 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb21f7-24e3-476e-9e87-5ae5cbd441a0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:38.746360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb21f7-24e3-476e-9e87-5ae5cbd441a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:38.746633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb21f7-24e3-476e-9e87-5ae5cbd441a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:38.756470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb21f7-24e3-476e-9e87-5ae5cbd441a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-17cb21f7-24e3-476e-9e87-5ae5cbd441a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:38.761218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:38.762467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:38.763559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 587/1141] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:38.768328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880aaa9c-79f6-4159-ab44-29f0cb959431 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:38.782814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:38.865236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880aaa9c-79f6-4159-ab44-29f0cb959431 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:38.898628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442162f-28f7-4d17-a889-aa91e45147b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:38.899262 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442162f-28f7-4d17-a889-aa91e45147b3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:38.899550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442162f-28f7-4d17-a889-aa91e45147b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:38.899824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442162f-28f7-4d17-a889-aa91e45147b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:38.900493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442162f-28f7-4d17-a889-aa91e45147b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:38.900800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442162f-28f7-4d17-a889-aa91e45147b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:38.902170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442162f-28f7-4d17-a889-aa91e45147b3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:38.910050 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 555/1142] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:38.916395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb21f7-24e3-476e-9e87-5ae5cbd441a0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:38.941848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:39.018228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb21f7-24e3-476e-9e87-5ae5cbd441a0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:39.052502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359118-6214-4ae6-839e-d284b09d4d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:39.053142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359118-6214-4ae6-839e-d284b09d4d46 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:39.053423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359118-6214-4ae6-839e-d284b09d4d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:39.053700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359118-6214-4ae6-839e-d284b09d4d46 None admin] PATH_INFO: `/v3/users/d5a57e1ac94d49d4a5f1dc48416fe216` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:39.067436 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f359118-6214-4ae6-839e-d284b09d4d46 None admin] RBAC: Authorizing `identity:get_user(user_id=d5a57e1ac94d49d4a5f1dc48416fe216)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:39.068890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f359118-6214-4ae6-839e-d284b09d4d46 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:39.070565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 588/1143] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:38 2022] GET /identity/v3/users/d5a57e1ac94d49d4a5f1dc48416fe216 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:39.076540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442162f-28f7-4d17-a889-aa91e45147b3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:39.152856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:39.175752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442162f-28f7-4d17-a889-aa91e45147b3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:39.211137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ba881-3063-41aa-a219-5aeea155dfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:39.211744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ba881-3063-41aa-a219-5aeea155dfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:39.212145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ba881-3063-41aa-a219-5aeea155dfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:39.212426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ba881-3063-41aa-a219-5aeea155dfd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:39.278725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ba881-3063-41aa-a219-5aeea155dfd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:39.280219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ba881-3063-41aa-a219-5aeea155dfd6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:39.352985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:39.375610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 556/1144] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:39.382256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359118-6214-4ae6-839e-d284b09d4d46 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:39.458678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:39.479240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359118-6214-4ae6-839e-d284b09d4d46 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:39.512842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39217a2-5915-489e-9cb0-e8e9abb69f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:39.513464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39217a2-5915-489e-9cb0-e8e9abb69f03 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:39.513748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39217a2-5915-489e-9cb0-e8e9abb69f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:39.514022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39217a2-5915-489e-9cb0-e8e9abb69f03 None admin] PATH_INFO: `/v3/projects/d7e0c0119ad24af7b681e0da9ec52bd0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:39.515184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39217a2-5915-489e-9cb0-e8e9abb69f03 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e0c0119ad24af7b681e0da9ec52bd0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:39.516622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39217a2-5915-489e-9cb0-e8e9abb69f03 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:39.518262 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 589/1145] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:39 2022] GET /identity/v3/projects/d7e0c0119ad24af7b681e0da9ec52bd0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:39.524830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ba881-3063-41aa-a219-5aeea155dfd6 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:39.621875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ba881-3063-41aa-a219-5aeea155dfd6 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:39.663505 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63875fb6-8781-47eb-87fb-745f915010da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:39.664105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63875fb6-8781-47eb-87fb-745f915010da None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:39.664386 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63875fb6-8781-47eb-87fb-745f915010da None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:39.664660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63875fb6-8781-47eb-87fb-745f915010da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:39.665390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63875fb6-8781-47eb-87fb-745f915010da None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=d7e0c0119ad24af7b681e0da9ec52bd0, user.id=d5a57e1ac94d49d4a5f1dc48416fe216) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:39.665701 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63875fb6-8781-47eb-87fb-745f915010da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:39.667156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63875fb6-8781-47eb-87fb-745f915010da None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:39.672556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 557/1146] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:39 2022] GET /identity/v3/role_assignments?user.id=d5a57e1ac94d49d4a5f1dc48416fe216&scope.project.id=d7e0c0119ad24af7b681e0da9ec52bd0&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:41.553847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b8806-87c7-44d8-8d94-6a2c0d8501af None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:41.554410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b8806-87c7-44d8-8d94-6a2c0d8501af None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:41.554410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b8806-87c7-44d8-8d94-6a2c0d8501af None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:41.555784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 590/1147] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:41.561136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118e05e-d1fb-4363-a7f1-7c9dce1cadda None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:41.561573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118e05e-d1fb-4363-a7f1-7c9dce1cadda None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:41.561693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118e05e-d1fb-4363-a7f1-7c9dce1cadda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:41.579809 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-7118e05e-d1fb-4363-a7f1-7c9dce1cadda None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:41.581035 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7118e05e-d1fb-4363-a7f1-7c9dce1cadda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:41.614800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:41.647423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 558/1148] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:41.921831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b8806-87c7-44d8-8d94-6a2c0d8501af None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:42.021930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b8806-87c7-44d8-8d94-6a2c0d8501af None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:42.055245 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fac05-b0d4-435a-8ccd-bd1aca1e605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:42.055859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fac05-b0d4-435a-8ccd-bd1aca1e605f None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:42.056139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fac05-b0d4-435a-8ccd-bd1aca1e605f None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:42.056412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fac05-b0d4-435a-8ccd-bd1aca1e605f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:42.066184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fac05-b0d4-435a-8ccd-bd1aca1e605f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-639fac05-b0d4-435a-8ccd-bd1aca1e605f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:42.070931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:42.072066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:42.072934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 591/1149] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:42.078189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118e05e-d1fb-4363-a7f1-7c9dce1cadda None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:42.174576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118e05e-d1fb-4363-a7f1-7c9dce1cadda None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:42.213045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b03ca8-31a2-401a-bc51-2b25e84e67a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:42.213648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03ca8-31a2-401a-bc51-2b25e84e67a8 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:42.213931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03ca8-31a2-401a-bc51-2b25e84e67a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:42.214204 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03ca8-31a2-401a-bc51-2b25e84e67a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:42.214873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b03ca8-31a2-401a-bc51-2b25e84e67a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:42.215207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b03ca8-31a2-401a-bc51-2b25e84e67a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:42.216580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b03ca8-31a2-401a-bc51-2b25e84e67a8 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:42.225379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 559/1150] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:42.232107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fac05-b0d4-435a-8ccd-bd1aca1e605f None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:42.241640 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:42.331393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fac05-b0d4-435a-8ccd-bd1aca1e605f None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:42.365676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547f18e-751a-4b5f-8b75-e2e65e032758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:42.366304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547f18e-751a-4b5f-8b75-e2e65e032758 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:42.366587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547f18e-751a-4b5f-8b75-e2e65e032758 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:42.366865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547f18e-751a-4b5f-8b75-e2e65e032758 None admin] PATH_INFO: `/v3/users/d5a57e1ac94d49d4a5f1dc48416fe216` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:42.368013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547f18e-751a-4b5f-8b75-e2e65e032758 None admin] RBAC: Authorizing `identity:get_user(user_id=d5a57e1ac94d49d4a5f1dc48416fe216)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:42.369459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547f18e-751a-4b5f-8b75-e2e65e032758 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:42.371074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 592/1151] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:42 2022] GET /identity/v3/users/d5a57e1ac94d49d4a5f1dc48416fe216 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:42.376864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b03ca8-31a2-401a-bc51-2b25e84e67a8 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:42.408557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:42.476080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b03ca8-31a2-401a-bc51-2b25e84e67a8 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:42.510196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08d7c4-cb88-442b-9086-7ae57f004cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:42.510821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d7c4-cb88-442b-9086-7ae57f004cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:42.511131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d7c4-cb88-442b-9086-7ae57f004cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:42.511409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d7c4-cb88-442b-9086-7ae57f004cb3 None admin] PATH_INFO: `/v3/projects/d7e0c0119ad24af7b681e0da9ec52bd0` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:42.512691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08d7c4-cb88-442b-9086-7ae57f004cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e0c0119ad24af7b681e0da9ec52bd0)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:42.514141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08d7c4-cb88-442b-9086-7ae57f004cb3 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:42.515823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 560/1152] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:42 2022] GET /identity/v3/projects/d7e0c0119ad24af7b681e0da9ec52bd0 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:42.522592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547f18e-751a-4b5f-8b75-e2e65e032758 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:42.597621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:42.621380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547f18e-751a-4b5f-8b75-e2e65e032758 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:42.654651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53871a-fa02-4378-9a7d-6b50fd73b666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:42.655323 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53871a-fa02-4378-9a7d-6b50fd73b666 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:42.655609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53871a-fa02-4378-9a7d-6b50fd73b666 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:42.655881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53871a-fa02-4378-9a7d-6b50fd73b666 None admin] PATH_INFO: `/v3/projects/d7e0c0119ad24af7b681e0da9ec52bd0/users/d5a57e1ac94d49d4a5f1dc48416fe216/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:42.657735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53871a-fa02-4378-9a7d-6b50fd73b666 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7e0c0119ad24af7b681e0da9ec52bd0, user_id=d5a57e1ac94d49d4a5f1dc48416fe216, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:42.659193 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53871a-fa02-4378-9a7d-6b50fd73b666 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:42.733458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 593/1153] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:28:42 2022] PUT /identity/v3/projects/d7e0c0119ad24af7b681e0da9ec52bd0/users/d5a57e1ac94d49d4a5f1dc48416fe216/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:28:44.631150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec022e9e-449f-40f9-aea4-56ab8877ff13 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:44.631680 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec022e9e-449f-40f9-aea4-56ab8877ff13 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:44.631680 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec022e9e-449f-40f9-aea4-56ab8877ff13 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:44.633047 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 561/1154] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:44.638413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327f28-7f9c-4e9f-be80-46d057b5d99a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:44.638818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327f28-7f9c-4e9f-be80-46d057b5d99a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:44.638966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327f28-7f9c-4e9f-be80-46d057b5d99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:44.657456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2d327f28-7f9c-4e9f-be80-46d057b5d99a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:44.658655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d327f28-7f9c-4e9f-be80-46d057b5d99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:44.724184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 594/1155] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:44.996303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec022e9e-449f-40f9-aea4-56ab8877ff13 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:45.091744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:45.095502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec022e9e-449f-40f9-aea4-56ab8877ff13 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:45.130222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0922f-45a9-43e8-b6a8-c05d5f0df30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:45.130843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0922f-45a9-43e8-b6a8-c05d5f0df30a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:45.131152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0922f-45a9-43e8-b6a8-c05d5f0df30a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:45.131428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0922f-45a9-43e8-b6a8-c05d5f0df30a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:45.141239 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0922f-45a9-43e8-b6a8-c05d5f0df30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-eff0922f-45a9-43e8-b6a8-c05d5f0df30a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:45.146518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:45.147629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:45.148539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 562/1156] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:45.154034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d327f28-7f9c-4e9f-be80-46d057b5d99a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:45.214007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:45.251149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d327f28-7f9c-4e9f-be80-46d057b5d99a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:45.286262 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7dc8-202f-439e-8822-160d1fce7217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:45.286865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7dc8-202f-439e-8822-160d1fce7217 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:45.287182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7dc8-202f-439e-8822-160d1fce7217 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:45.287458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7dc8-202f-439e-8822-160d1fce7217 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:45.288118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce7dc8-202f-439e-8822-160d1fce7217 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:45.288422 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce7dc8-202f-439e-8822-160d1fce7217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:45.289801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce7dc8-202f-439e-8822-160d1fce7217 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:45.297630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 595/1157] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:45.304063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0922f-45a9-43e8-b6a8-c05d5f0df30a None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:45.401547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0922f-45a9-43e8-b6a8-c05d5f0df30a None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:45.434943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a11a-6b13-4881-94eb-ef0252b89f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:45.435594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a11a-6b13-4881-94eb-ef0252b89f0f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:45.435875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a11a-6b13-4881-94eb-ef0252b89f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:45.436149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a11a-6b13-4881-94eb-ef0252b89f0f None admin] PATH_INFO: `/v3/users/d5a57e1ac94d49d4a5f1dc48416fe216` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:45.437271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5a11a-6b13-4881-94eb-ef0252b89f0f None admin] RBAC: Authorizing `identity:get_user(user_id=d5a57e1ac94d49d4a5f1dc48416fe216)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:45.438708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5a11a-6b13-4881-94eb-ef0252b89f0f None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:45.440339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 563/1158] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:45 2022] GET /identity/v3/users/d5a57e1ac94d49d4a5f1dc48416fe216 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:45.446314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7dc8-202f-439e-8822-160d1fce7217 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:45.549969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7dc8-202f-439e-8822-160d1fce7217 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:45.574843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:45.583402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea37eb8-a416-4b77-9e6d-c81f45578084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:45.584064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea37eb8-a416-4b77-9e6d-c81f45578084 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:45.584347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea37eb8-a416-4b77-9e6d-c81f45578084 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:45.588752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea37eb8-a416-4b77-9e6d-c81f45578084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:45.651351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea37eb8-a416-4b77-9e6d-c81f45578084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:45.652841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea37eb8-a416-4b77-9e6d-c81f45578084 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:45.747705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 596/1159] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:45.753603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a11a-6b13-4881-94eb-ef0252b89f0f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:45.781817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:45.852039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a11a-6b13-4881-94eb-ef0252b89f0f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:45.895629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5176f74-df68-4f52-abc1-a92e88086be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:45.896274 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176f74-df68-4f52-abc1-a92e88086be1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:45.896557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176f74-df68-4f52-abc1-a92e88086be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:45.898593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176f74-df68-4f52-abc1-a92e88086be1 None admin] PATH_INFO: `/v3/projects/d7e0c0119ad24af7b681e0da9ec52bd0` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:45.899773 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5176f74-df68-4f52-abc1-a92e88086be1 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e0c0119ad24af7b681e0da9ec52bd0)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:45.901217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5176f74-df68-4f52-abc1-a92e88086be1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:45.902889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 564/1160] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:45 2022] GET /identity/v3/projects/d7e0c0119ad24af7b681e0da9ec52bd0 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:45.909006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea37eb8-a416-4b77-9e6d-c81f45578084 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:45.935703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:46.006671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea37eb8-a416-4b77-9e6d-c81f45578084 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:46.039707 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba914ad-7d18-447d-97e8-9048229392ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:46.040306 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba914ad-7d18-447d-97e8-9048229392ef None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:46.040586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba914ad-7d18-447d-97e8-9048229392ef None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:46.040859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba914ad-7d18-447d-97e8-9048229392ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:46.041580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba914ad-7d18-447d-97e8-9048229392ef None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=d7e0c0119ad24af7b681e0da9ec52bd0, user.id=d5a57e1ac94d49d4a5f1dc48416fe216) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:46.041887 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba914ad-7d18-447d-97e8-9048229392ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:46.043345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba914ad-7d18-447d-97e8-9048229392ef None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:46.048982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 597/1161] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:45 2022] GET /identity/v3/role_assignments?user.id=d5a57e1ac94d49d4a5f1dc48416fe216&scope.project.id=d7e0c0119ad24af7b681e0da9ec52bd0&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:47.951432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb645c72-232a-4ea8-a085-956517986a0b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:47.951957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb645c72-232a-4ea8-a085-956517986a0b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:47.951957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb645c72-232a-4ea8-a085-956517986a0b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:47.953314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 565/1162] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:47.959017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4293b4-d723-4566-8cdf-03f5e06056ca None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:47.959488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4293b4-d723-4566-8cdf-03f5e06056ca None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:47.959580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4293b4-d723-4566-8cdf-03f5e06056ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:47.982453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-de4293b4-d723-4566-8cdf-03f5e06056ca None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:47.983687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-de4293b4-d723-4566-8cdf-03f5e06056ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:48.047868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 598/1163] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:48.316371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb645c72-232a-4ea8-a085-956517986a0b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:48.410955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:48.417532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb645c72-232a-4ea8-a085-956517986a0b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:48.452564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1b85-7533-4c3d-92f3-ab0858b2d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:48.453168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1b85-7533-4c3d-92f3-ab0858b2d237 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:48.453452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1b85-7533-4c3d-92f3-ab0858b2d237 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:48.453727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1b85-7533-4c3d-92f3-ab0858b2d237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:48.519392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce1b85-7533-4c3d-92f3-ab0858b2d237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:48.520903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce1b85-7533-4c3d-92f3-ab0858b2d237 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:48.609958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:48.616118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 566/1164] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:48.622071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4293b4-d723-4566-8cdf-03f5e06056ca None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:48.642654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:48.717943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4293b4-d723-4566-8cdf-03f5e06056ca None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:48.751422 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba4ed4-1359-45af-bd74-9324f0c6075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:48.752045 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4ed4-1359-45af-bd74-9324f0c6075d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:48.752329 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4ed4-1359-45af-bd74-9324f0c6075d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:48.752602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4ed4-1359-45af-bd74-9324f0c6075d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:48.759107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba4ed4-1359-45af-bd74-9324f0c6075d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:48.760560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba4ed4-1359-45af-bd74-9324f0c6075d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a7ba4ed4-1359-45af-bd74-9324f0c6075d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:48.772115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:48.773317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:28:48.774346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 599/1165] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 03:28:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:48.779415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1b85-7533-4c3d-92f3-ab0858b2d237 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:48.877166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1b85-7533-4c3d-92f3-ab0858b2d237 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:48.910779 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60050666-e7e4-42fd-9c36-1ad10ce17c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:48.911405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050666-e7e4-42fd-9c36-1ad10ce17c1a None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:48.911688 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050666-e7e4-42fd-9c36-1ad10ce17c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:48.911961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60050666-e7e4-42fd-9c36-1ad10ce17c1a None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:48.912603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60050666-e7e4-42fd-9c36-1ad10ce17c1a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:48.912907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60050666-e7e4-42fd-9c36-1ad10ce17c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:48.914302 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60050666-e7e4-42fd-9c36-1ad10ce17c1a None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:48.921297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 567/1166] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 03:28:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:50.806821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c18a-7447-4db9-8a1f-36acee68ca5c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:50.807477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c18a-7447-4db9-8a1f-36acee68ca5c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:50.807477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c18a-7447-4db9-8a1f-36acee68ca5c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:50.808744 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 600/1167] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:50.813907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c9a67-2fb3-43f4-9b00-bb2c12d4a9d3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:50.814358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c9a67-2fb3-43f4-9b00-bb2c12d4a9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:50.814457 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c9a67-2fb3-43f4-9b00-bb2c12d4a9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:50.832651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-081c9a67-2fb3-43f4-9b00-bb2c12d4a9d3 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:50.833831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-081c9a67-2fb3-43f4-9b00-bb2c12d4a9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:50.898042 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:50.914357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 568/1168] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:51.194624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c18a-7447-4db9-8a1f-36acee68ca5c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:51.274650 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:51.294240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c18a-7447-4db9-8a1f-36acee68ca5c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:51.327656 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d0059-a0d5-418b-a2b1-2ed1b215a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:51.328255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d0059-a0d5-418b-a2b1-2ed1b215a259 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:51.328535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d0059-a0d5-418b-a2b1-2ed1b215a259 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:51.328806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d0059-a0d5-418b-a2b1-2ed1b215a259 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:51.329457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d0059-a0d5-418b-a2b1-2ed1b215a259 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:51.330831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d0059-a0d5-418b-a2b1-2ed1b215a259 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:51.385510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 601/1169] 10.222.0.88 () {60 vars in 1138 bytes} [Wed Aug 24 03:28:51 2022] POST /identity/v3/domains => generated 267 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:53.306409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af334113-62ff-446f-8f0d-3116b246f9da None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:53.306971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af334113-62ff-446f-8f0d-3116b246f9da None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:53.306971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af334113-62ff-446f-8f0d-3116b246f9da None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:53.308525 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 569/1170] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:53.313749 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610039-34be-467c-9e16-2737d532edb5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:53.314163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610039-34be-467c-9e16-2737d532edb5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:53.314299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610039-34be-467c-9e16-2737d532edb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:53.333492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0c610039-34be-467c-9e16-2737d532edb5 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:53.334682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0c610039-34be-467c-9e16-2737d532edb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:53.400956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 602/1171] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:53.664777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af334113-62ff-446f-8f0d-3116b246f9da None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:53.763856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af334113-62ff-446f-8f0d-3116b246f9da None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:53.796783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b854a8-b6d1-4376-87b4-64a7ef3a765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:53.797397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b854a8-b6d1-4376-87b4-64a7ef3a765c None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:53.797678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b854a8-b6d1-4376-87b4-64a7ef3a765c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:53.797949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b854a8-b6d1-4376-87b4-64a7ef3a765c None admin] PATH_INFO: `/v3/domains/e2cbc110658f47948dd3eded3793cf68` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:53.808037 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b854a8-b6d1-4376-87b4-64a7ef3a765c None admin] RBAC: Authorizing `identity:get_domain(domain_id=e2cbc110658f47948dd3eded3793cf68)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:53.809489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b854a8-b6d1-4376-87b4-64a7ef3a765c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:53.811069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 570/1172] 10.222.0.88 () {56 vars in 1183 bytes} [Wed Aug 24 03:28:53 2022] GET /identity/v3/domains/e2cbc110658f47948dd3eded3793cf68 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:53.817301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c610039-34be-467c-9e16-2737d532edb5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:53.885424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:53.914370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c610039-34be-467c-9e16-2737d532edb5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:53.948472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23e1f7-016b-4104-87a6-7190cd27a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:53.949003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23e1f7-016b-4104-87a6-7190cd27a6a9 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:53.949280 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23e1f7-016b-4104-87a6-7190cd27a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:53.949550 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23e1f7-016b-4104-87a6-7190cd27a6a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:53.950182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23e1f7-016b-4104-87a6-7190cd27a6a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:53.951640 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23e1f7-016b-4104-87a6-7190cd27a6a9 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:54.071620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 603/1173] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:28:53 2022] POST /identity/v3/projects => generated 361 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:56.025574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5e92c-4f65-45bf-a0ef-f3d8069c31ad None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:56.026134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5e92c-4f65-45bf-a0ef-f3d8069c31ad None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:56.026232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5e92c-4f65-45bf-a0ef-f3d8069c31ad None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:56.027792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 571/1174] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:56.033111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08455c32-c920-483e-9294-7605dc6e9dcc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:56.033552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08455c32-c920-483e-9294-7605dc6e9dcc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:56.033665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08455c32-c920-483e-9294-7605dc6e9dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:56.052468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-08455c32-c920-483e-9294-7605dc6e9dcc None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:56.053666 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-08455c32-c920-483e-9294-7605dc6e9dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:56.118813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 604/1175] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:56.397439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5e92c-4f65-45bf-a0ef-f3d8069c31ad None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:56.448762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:56.499155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5e92c-4f65-45bf-a0ef-f3d8069c31ad None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:56.532214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1801f49-e49b-4d10-96f6-7ac0d0359fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:56.532838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801f49-e49b-4d10-96f6-7ac0d0359fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:56.533119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801f49-e49b-4d10-96f6-7ac0d0359fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:56.533392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801f49-e49b-4d10-96f6-7ac0d0359fc7 None admin] PATH_INFO: `/v3/domains/e2cbc110658f47948dd3eded3793cf68` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:56.534526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1801f49-e49b-4d10-96f6-7ac0d0359fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e2cbc110658f47948dd3eded3793cf68)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:56.536509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1801f49-e49b-4d10-96f6-7ac0d0359fc7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:56.538105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 572/1176] 10.222.0.88 () {56 vars in 1183 bytes} [Wed Aug 24 03:28:56 2022] GET /identity/v3/domains/e2cbc110658f47948dd3eded3793cf68 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:56.544373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08455c32-c920-483e-9294-7605dc6e9dcc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:56.607332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:56.652228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08455c32-c920-483e-9294-7605dc6e9dcc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:56.686010 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdadd6-32b4-4128-be27-89012184cae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:56.686618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdadd6-32b4-4128-be27-89012184cae2 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:56.686900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdadd6-32b4-4128-be27-89012184cae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:56.687201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdadd6-32b4-4128-be27-89012184cae2 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:56.687854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdadd6-32b4-4128-be27-89012184cae2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:56.689290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdadd6-32b4-4128-be27-89012184cae2 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:56.766841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 605/1177] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:28:56 2022] POST /identity/v3/users => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:28:58.754265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe012d-7d27-484f-8ced-b4a0a2a96344 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:58.754839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe012d-7d27-484f-8ced-b4a0a2a96344 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:58.754839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe012d-7d27-484f-8ced-b4a0a2a96344 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:58.756209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 573/1178] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:28:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:58.761432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d685-8ae4-4385-a44f-1b82de040173 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:58.761852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d685-8ae4-4385-a44f-1b82de040173 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:58.761965 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175d685-8ae4-4385-a44f-1b82de040173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:58.780202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9175d685-8ae4-4385-a44f-1b82de040173 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:58.781388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9175d685-8ae4-4385-a44f-1b82de040173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:58.845877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 606/1179] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:59.111463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe012d-7d27-484f-8ced-b4a0a2a96344 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:59.212262 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe012d-7d27-484f-8ced-b4a0a2a96344 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:59.229062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:59.245544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48248c-9181-4525-838d-1fb29cb27bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:59.246296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48248c-9181-4525-838d-1fb29cb27bea None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:59.246487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48248c-9181-4525-838d-1fb29cb27bea None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:59.246767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48248c-9181-4525-838d-1fb29cb27bea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:59.257164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48248c-9181-4525-838d-1fb29cb27bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-1e48248c-9181-4525-838d-1fb29cb27bea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:59.261896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:59.263124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:28:59.264242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 574/1180] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:59.269048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175d685-8ae4-4385-a44f-1b82de040173 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:59.307961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:59.367522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175d685-8ae4-4385-a44f-1b82de040173 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:59.400477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600475cc-c0f6-4488-a795-8ea2751391ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:59.401080 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600475cc-c0f6-4488-a795-8ea2751391ab None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:59.401367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600475cc-c0f6-4488-a795-8ea2751391ab None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:59.401642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600475cc-c0f6-4488-a795-8ea2751391ab None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:59.402306 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600475cc-c0f6-4488-a795-8ea2751391ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:59.402612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600475cc-c0f6-4488-a795-8ea2751391ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:59.404018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600475cc-c0f6-4488-a795-8ea2751391ab None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:59.411909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 607/1181] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:59.417733 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48248c-9181-4525-838d-1fb29cb27bea None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:59.516164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48248c-9181-4525-838d-1fb29cb27bea None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:59.548797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bffb3d-8adc-425e-bade-522ab496b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:59.549402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bffb3d-8adc-425e-bade-522ab496b81d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:59.549678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bffb3d-8adc-425e-bade-522ab496b81d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:59.549949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bffb3d-8adc-425e-bade-522ab496b81d None admin] PATH_INFO: `/v3/users/41472be1124c4797bae3b23aa75a8750` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:59.563460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bffb3d-8adc-425e-bade-522ab496b81d None admin] RBAC: Authorizing `identity:get_user(user_id=41472be1124c4797bae3b23aa75a8750)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:59.564899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bffb3d-8adc-425e-bade-522ab496b81d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:59.567011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 575/1182] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:59 2022] GET /identity/v3/users/41472be1124c4797bae3b23aa75a8750 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:28:59.573021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600475cc-c0f6-4488-a795-8ea2751391ab None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:59.668815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:59.671670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600475cc-c0f6-4488-a795-8ea2751391ab None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:59.704656 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85c051-ea76-46b9-bef4-374f718ba7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:59.705258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85c051-ea76-46b9-bef4-374f718ba7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:59.705538 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85c051-ea76-46b9-bef4-374f718ba7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:59.705808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85c051-ea76-46b9-bef4-374f718ba7a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:59.771889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85c051-ea76-46b9-bef4-374f718ba7a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:59.773363 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85c051-ea76-46b9-bef4-374f718ba7a5 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:59.865164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:59.868805 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 608/1183] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:59.874743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bffb3d-8adc-425e-bade-522ab496b81d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:59.909121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:59.973236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bffb3d-8adc-425e-bade-522ab496b81d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:00.006706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22fd1b-8485-4014-a570-e8591a7aae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:00.007357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22fd1b-8485-4014-a570-e8591a7aae7e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:00.007637 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22fd1b-8485-4014-a570-e8591a7aae7e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:00.007912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22fd1b-8485-4014-a570-e8591a7aae7e None admin] PATH_INFO: `/v3/projects/6a959fbcab8a4dadb5f9546a28d7ee7b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:00.009023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22fd1b-8485-4014-a570-e8591a7aae7e None admin] RBAC: Authorizing `identity:get_project(project_id=6a959fbcab8a4dadb5f9546a28d7ee7b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:00.010456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22fd1b-8485-4014-a570-e8591a7aae7e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:00.012121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 576/1184] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:59 2022] GET /identity/v3/projects/6a959fbcab8a4dadb5f9546a28d7ee7b => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:00.018202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85c051-ea76-46b9-bef4-374f718ba7a5 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:00.114536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85c051-ea76-46b9-bef4-374f718ba7a5 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:00.147432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646eb1b5-5271-409c-a39d-691bbbb43c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:00.148031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eb1b5-5271-409c-a39d-691bbbb43c94 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:00.148312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eb1b5-5271-409c-a39d-691bbbb43c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:00.148587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eb1b5-5271-409c-a39d-691bbbb43c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:00.149310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646eb1b5-5271-409c-a39d-691bbbb43c94 None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=6a959fbcab8a4dadb5f9546a28d7ee7b, user.id=41472be1124c4797bae3b23aa75a8750) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:00.149620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646eb1b5-5271-409c-a39d-691bbbb43c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:00.151070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646eb1b5-5271-409c-a39d-691bbbb43c94 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:00.156350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 609/1185] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:29:00 2022] GET /identity/v3/role_assignments?user.id=41472be1124c4797bae3b23aa75a8750&scope.project.id=6a959fbcab8a4dadb5f9546a28d7ee7b&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:02.107897 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6276e-a356-4b19-af2b-0d4e365b6ac8 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:02.108421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6276e-a356-4b19-af2b-0d4e365b6ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:02.108421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6276e-a356-4b19-af2b-0d4e365b6ac8 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:02.109799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 577/1186] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:29:02.115563 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661f7e9-b29a-4e74-bb06-90da8a566e3c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:02.115996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661f7e9-b29a-4e74-bb06-90da8a566e3c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:02.116120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661f7e9-b29a-4e74-bb06-90da8a566e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:02.134887 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3661f7e9-b29a-4e74-bb06-90da8a566e3c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:29:02.136063 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3661f7e9-b29a-4e74-bb06-90da8a566e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:29:02.193065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:02.201185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 610/1187] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:29:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:29:02.468855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6276e-a356-4b19-af2b-0d4e365b6ac8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:02.568339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6276e-a356-4b19-af2b-0d4e365b6ac8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:02.570593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:02.600953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7b46-35e8-406c-a090-3663dc0237c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:02.602033 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7b46-35e8-406c-a090-3663dc0237c3 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:02.602580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7b46-35e8-406c-a090-3663dc0237c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:02.602854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7b46-35e8-406c-a090-3663dc0237c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:02.612768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca7b46-35e8-406c-a090-3663dc0237c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-98ca7b46-35e8-406c-a090-3663dc0237c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:29:02.617487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:02.618558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:29:02.619605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 578/1188] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:29:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:02.624601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661f7e9-b29a-4e74-bb06-90da8a566e3c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:02.721614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661f7e9-b29a-4e74-bb06-90da8a566e3c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:02.756089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62820ed3-1b8e-4d84-8b22-bf9a493b8d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:02.756696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62820ed3-1b8e-4d84-8b22-bf9a493b8d3d None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:02.756980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62820ed3-1b8e-4d84-8b22-bf9a493b8d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:02.757257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62820ed3-1b8e-4d84-8b22-bf9a493b8d3d None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:02.757926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62820ed3-1b8e-4d84-8b22-bf9a493b8d3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:02.758233 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62820ed3-1b8e-4d84-8b22-bf9a493b8d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:02.759647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62820ed3-1b8e-4d84-8b22-bf9a493b8d3d None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:02.767984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 611/1189] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:02.774644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7b46-35e8-406c-a090-3663dc0237c3 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:02.872778 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7b46-35e8-406c-a090-3663dc0237c3 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:02.905767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e414527-ed95-48d6-a1a9-a55d5aba7faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:02.906377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414527-ed95-48d6-a1a9-a55d5aba7faf None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:02.906654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414527-ed95-48d6-a1a9-a55d5aba7faf None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:02.906926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414527-ed95-48d6-a1a9-a55d5aba7faf None admin] PATH_INFO: `/v3/users/41472be1124c4797bae3b23aa75a8750` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:02.908055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e414527-ed95-48d6-a1a9-a55d5aba7faf None admin] RBAC: Authorizing `identity:get_user(user_id=41472be1124c4797bae3b23aa75a8750)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:02.909489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e414527-ed95-48d6-a1a9-a55d5aba7faf None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:02.911054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 579/1190] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:29:02 2022] GET /identity/v3/users/41472be1124c4797bae3b23aa75a8750 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:02.916910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62820ed3-1b8e-4d84-8b22-bf9a493b8d3d None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:02.973021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:03.016892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62820ed3-1b8e-4d84-8b22-bf9a493b8d3d None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:03.049132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed5211-10cc-4e4c-aa3e-0c6df3573083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:03.049758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5211-10cc-4e4c-aa3e-0c6df3573083 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:03.050549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5211-10cc-4e4c-aa3e-0c6df3573083 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:03.050822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5211-10cc-4e4c-aa3e-0c6df3573083 None admin] PATH_INFO: `/v3/projects/6a959fbcab8a4dadb5f9546a28d7ee7b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:03.051941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed5211-10cc-4e4c-aa3e-0c6df3573083 None admin] RBAC: Authorizing `identity:get_project(project_id=6a959fbcab8a4dadb5f9546a28d7ee7b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:03.053377 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed5211-10cc-4e4c-aa3e-0c6df3573083 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:03.054997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 612/1191] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:29:02 2022] GET /identity/v3/projects/6a959fbcab8a4dadb5f9546a28d7ee7b => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:03.061046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e414527-ed95-48d6-a1a9-a55d5aba7faf None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:03.093115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:03.160372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e414527-ed95-48d6-a1a9-a55d5aba7faf None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:03.193983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6a628-f1b6-4c12-82c5-55b6917a8891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:03.194634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6a628-f1b6-4c12-82c5-55b6917a8891 None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:03.194920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6a628-f1b6-4c12-82c5-55b6917a8891 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:03.195230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6a628-f1b6-4c12-82c5-55b6917a8891 None admin] PATH_INFO: `/v3/projects/6a959fbcab8a4dadb5f9546a28d7ee7b/users/41472be1124c4797bae3b23aa75a8750/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:03.197166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6a628-f1b6-4c12-82c5-55b6917a8891 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a959fbcab8a4dadb5f9546a28d7ee7b, user_id=41472be1124c4797bae3b23aa75a8750, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:03.198598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6a628-f1b6-4c12-82c5-55b6917a8891 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:03.269668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 580/1192] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:29:03 2022] PUT /identity/v3/projects/6a959fbcab8a4dadb5f9546a28d7ee7b/users/41472be1124c4797bae3b23aa75a8750/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:29:05.147701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18511a1-3450-4c4d-a55a-76cec601725b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:05.148214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18511a1-3450-4c4d-a55a-76cec601725b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:05.148214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18511a1-3450-4c4d-a55a-76cec601725b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:05.149521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 613/1193] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:29:05.154823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf63eb-6c90-4028-a0f1-2ae59f26ebdb None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:05.155275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf63eb-6c90-4028-a0f1-2ae59f26ebdb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:05.155422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf63eb-6c90-4028-a0f1-2ae59f26ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:05.173095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-95bf63eb-6c90-4028-a0f1-2ae59f26ebdb None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:29:05.174292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-95bf63eb-6c90-4028-a0f1-2ae59f26ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:29:05.244351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 581/1194] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:29:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:29:05.518566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18511a1-3450-4c4d-a55a-76cec601725b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:05.619542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18511a1-3450-4c4d-a55a-76cec601725b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:05.641921 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:05.652415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e33a5-d2cf-4b20-80fa-e0a7d3558225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:05.653040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e33a5-d2cf-4b20-80fa-e0a7d3558225 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:05.653330 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e33a5-d2cf-4b20-80fa-e0a7d3558225 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:05.653604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e33a5-d2cf-4b20-80fa-e0a7d3558225 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:05.669863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e33a5-d2cf-4b20-80fa-e0a7d3558225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-555e33a5-d2cf-4b20-80fa-e0a7d3558225 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:29:05.677822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:05.678958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:29:05.680266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 614/1195] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:29:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:05.685079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf63eb-6c90-4028-a0f1-2ae59f26ebdb None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:05.708415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:05.785010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf63eb-6c90-4028-a0f1-2ae59f26ebdb None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:05.817843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c9e61-b7b8-4d78-b63d-7bad4f249268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:05.818438 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9e61-b7b8-4d78-b63d-7bad4f249268 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:05.818722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9e61-b7b8-4d78-b63d-7bad4f249268 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:05.818995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9e61-b7b8-4d78-b63d-7bad4f249268 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:05.819696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c9e61-b7b8-4d78-b63d-7bad4f249268 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:05.820002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c9e61-b7b8-4d78-b63d-7bad4f249268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:05.821369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c9e61-b7b8-4d78-b63d-7bad4f249268 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:05.829224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 582/1196] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:29:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:05.835153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e33a5-d2cf-4b20-80fa-e0a7d3558225 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:05.933583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e33a5-d2cf-4b20-80fa-e0a7d3558225 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:05.966602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d606217-bd7c-4bc4-b80f-1fccdd5517ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:05.967260 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d606217-bd7c-4bc4-b80f-1fccdd5517ea None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:05.967542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d606217-bd7c-4bc4-b80f-1fccdd5517ea None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:05.967817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d606217-bd7c-4bc4-b80f-1fccdd5517ea None admin] PATH_INFO: `/v3/users/41472be1124c4797bae3b23aa75a8750` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:05.968932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d606217-bd7c-4bc4-b80f-1fccdd5517ea None admin] RBAC: Authorizing `identity:get_user(user_id=41472be1124c4797bae3b23aa75a8750)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:05.970366 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d606217-bd7c-4bc4-b80f-1fccdd5517ea None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:05.972673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 615/1197] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 03:29:05 2022] GET /identity/v3/users/41472be1124c4797bae3b23aa75a8750 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:05.978955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c9e61-b7b8-4d78-b63d-7bad4f249268 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:06.067494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:06.083265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c9e61-b7b8-4d78-b63d-7bad4f249268 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:06.116458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad6691-2e13-4273-961c-9fd0b522fdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:06.117061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad6691-2e13-4273-961c-9fd0b522fdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:06.117344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad6691-2e13-4273-961c-9fd0b522fdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:06.117615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad6691-2e13-4273-961c-9fd0b522fdd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:06.182165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad6691-2e13-4273-961c-9fd0b522fdd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:06.183648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad6691-2e13-4273-961c-9fd0b522fdd7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:06.263607 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:06.279769 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 583/1198] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:29:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:06.285724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d606217-bd7c-4bc4-b80f-1fccdd5517ea None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:06.338691 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:06.384795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d606217-bd7c-4bc4-b80f-1fccdd5517ea None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:06.417670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60263ff2-d835-4489-8264-1d4b0eb38255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:06.418295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60263ff2-d835-4489-8264-1d4b0eb38255 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:06.418577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60263ff2-d835-4489-8264-1d4b0eb38255 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:06.418847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60263ff2-d835-4489-8264-1d4b0eb38255 None admin] PATH_INFO: `/v3/projects/6a959fbcab8a4dadb5f9546a28d7ee7b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:06.419975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60263ff2-d835-4489-8264-1d4b0eb38255 None admin] RBAC: Authorizing `identity:get_project(project_id=6a959fbcab8a4dadb5f9546a28d7ee7b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:06.421401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60263ff2-d835-4489-8264-1d4b0eb38255 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:06.423035 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 616/1199] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 03:29:06 2022] GET /identity/v3/projects/6a959fbcab8a4dadb5f9546a28d7ee7b => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:06.429254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad6691-2e13-4273-961c-9fd0b522fdd7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:06.526475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad6691-2e13-4273-961c-9fd0b522fdd7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:06.559366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8c131-8c22-4754-834e-647d8aeec89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:06.559955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8c131-8c22-4754-834e-647d8aeec89e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:06.560235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8c131-8c22-4754-834e-647d8aeec89e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:06.560512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8c131-8c22-4754-834e-647d8aeec89e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:06.561238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8c131-8c22-4754-834e-647d8aeec89e None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=6a959fbcab8a4dadb5f9546a28d7ee7b, user.id=41472be1124c4797bae3b23aa75a8750) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:06.561551 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8c131-8c22-4754-834e-647d8aeec89e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:06.562989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8c131-8c22-4754-834e-647d8aeec89e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:06.569161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 584/1200] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:29:06 2022] GET /identity/v3/role_assignments?user.id=41472be1124c4797bae3b23aa75a8750&scope.project.id=6a959fbcab8a4dadb5f9546a28d7ee7b&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:16.413552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=40 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:16.566583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=76 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:31.471392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828d4ff-5afb-448b-bfe9-85dbfe881c75 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:31.471970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828d4ff-5afb-448b-bfe9-85dbfe881c75 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:31.471970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828d4ff-5afb-448b-bfe9-85dbfe881c75 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:31.474151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 617/1201] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:30:31.479707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb234ab-1b0a-4b6f-81dc-509fbcebb5b4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:31.484056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb234ab-1b0a-4b6f-81dc-509fbcebb5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:31.484056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb234ab-1b0a-4b6f-81dc-509fbcebb5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:31.498571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ddb234ab-1b0a-4b6f-81dc-509fbcebb5b4 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:31.499815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ddb234ab-1b0a-4b6f-81dc-509fbcebb5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:31.581920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 585/1202] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:31.856149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828d4ff-5afb-448b-bfe9-85dbfe881c75 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:31.972566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828d4ff-5afb-448b-bfe9-85dbfe881c75 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:32.007951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d55fd0-5e33-4fd9-ad39-9e0ded403857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:32.008593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d55fd0-5e33-4fd9-ad39-9e0ded403857 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:32.008871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d55fd0-5e33-4fd9-ad39-9e0ded403857 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:32.009238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d55fd0-5e33-4fd9-ad39-9e0ded403857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:32.020259 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d55fd0-5e33-4fd9-ad39-9e0ded403857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:32.023644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d55fd0-5e33-4fd9-ad39-9e0ded403857 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-27d55fd0-5e33-4fd9-ad39-9e0ded403857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:32.037603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:32.038864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:32.040028 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:32.040028 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:32.040028 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:32.040028 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 618/1203] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:32.045296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb234ab-1b0a-4b6f-81dc-509fbcebb5b4 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:32.167187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb234ab-1b0a-4b6f-81dc-509fbcebb5b4 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:32.188949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:32.194735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1668bee-ce63-405b-ba57-b9367d7f31db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:32.195379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1668bee-ce63-405b-ba57-b9367d7f31db None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:32.195667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1668bee-ce63-405b-ba57-b9367d7f31db None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:32.196344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1668bee-ce63-405b-ba57-b9367d7f31db None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:32.196581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1668bee-ce63-405b-ba57-b9367d7f31db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:32.196889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1668bee-ce63-405b-ba57-b9367d7f31db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:32.198257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1668bee-ce63-405b-ba57-b9367d7f31db None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:32.209926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 586/1204] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:32.215768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d55fd0-5e33-4fd9-ad39-9e0ded403857 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:32.276329 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:32.328868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d55fd0-5e33-4fd9-ad39-9e0ded403857 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:32.363236 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432bdc5-92e3-4d0f-8fac-48e3a74cb57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:32.370301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432bdc5-92e3-4d0f-8fac-48e3a74cb57c None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:32.370301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432bdc5-92e3-4d0f-8fac-48e3a74cb57c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:32.370301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432bdc5-92e3-4d0f-8fac-48e3a74cb57c None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:32.370301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432bdc5-92e3-4d0f-8fac-48e3a74cb57c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:32.370301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432bdc5-92e3-4d0f-8fac-48e3a74cb57c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:32.661602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 619/1205] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 03:30:32 2022] POST /identity/v3/users => generated 251 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:30:34.636736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdd619-19e8-444a-be56-722ea9b9faa9 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:34.637251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdd619-19e8-444a-be56-722ea9b9faa9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:34.637359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdd619-19e8-444a-be56-722ea9b9faa9 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:34.639234 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 587/1206] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:34.644672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4393924-aebf-43da-97ef-df89d469b826 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:34.645139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4393924-aebf-43da-97ef-df89d469b826 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:34.645251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4393924-aebf-43da-97ef-df89d469b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:34.664703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d4393924-aebf-43da-97ef-df89d469b826 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:34.665906 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d4393924-aebf-43da-97ef-df89d469b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:34.736024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 620/1207] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:30:35.002274 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdd619-19e8-444a-be56-722ea9b9faa9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:35.120060 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdd619-19e8-444a-be56-722ea9b9faa9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:35.156190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a0f32-eec7-4e82-8ab5-4906f58a0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:35.156875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0f32-eec7-4e82-8ab5-4906f58a0ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:35.157156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0f32-eec7-4e82-8ab5-4906f58a0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:35.157429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0f32-eec7-4e82-8ab5-4906f58a0ed4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:35.168252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a0f32-eec7-4e82-8ab5-4906f58a0ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-e13a0f32-eec7-4e82-8ab5-4906f58a0ed4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:35.173129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:35.174269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:35.175227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 588/1208] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:30:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:35.180508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4393924-aebf-43da-97ef-df89d469b826 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:35.225541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:35.289055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4393924-aebf-43da-97ef-df89d469b826 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:35.323635 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242be52-1209-4f70-9c58-ea6036998052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:35.324262 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242be52-1209-4f70-9c58-ea6036998052 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:35.324541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242be52-1209-4f70-9c58-ea6036998052 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:35.324817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242be52-1209-4f70-9c58-ea6036998052 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:35.325494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242be52-1209-4f70-9c58-ea6036998052 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:35.325799 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242be52-1209-4f70-9c58-ea6036998052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:35.327746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242be52-1209-4f70-9c58-ea6036998052 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:35.336853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 621/1209] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:30:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:35.343062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a0f32-eec7-4e82-8ab5-4906f58a0ed4 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:35.397763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:35.450548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a0f32-eec7-4e82-8ab5-4906f58a0ed4 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:35.484967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68008-14f6-432c-b3b3-5f58adec6400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:35.485604 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68008-14f6-432c-b3b3-5f58adec6400 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:35.485878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68008-14f6-432c-b3b3-5f58adec6400 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:35.486148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68008-14f6-432c-b3b3-5f58adec6400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:35.497299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68008-14f6-432c-b3b3-5f58adec6400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:35.499297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68008-14f6-432c-b3b3-5f58adec6400 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-12a68008-14f6-432c-b3b3-5f58adec6400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:35.515387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:35.516884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:35.518338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:35.518338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:35.518338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:35.518338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 589/1210] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:35.522780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242be52-1209-4f70-9c58-ea6036998052 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:35.626941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:35.629984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242be52-1209-4f70-9c58-ea6036998052 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:35.665072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a147b4-e3cf-4f48-9bb8-7cb274ae8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:35.665706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a147b4-e3cf-4f48-9bb8-7cb274ae8a35 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:35.665938 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a147b4-e3cf-4f48-9bb8-7cb274ae8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:35.666208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a147b4-e3cf-4f48-9bb8-7cb274ae8a35 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:35.666893 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a147b4-e3cf-4f48-9bb8-7cb274ae8a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:35.667219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a147b4-e3cf-4f48-9bb8-7cb274ae8a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:35.668598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a147b4-e3cf-4f48-9bb8-7cb274ae8a35 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:35.680386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 622/1211] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:35.686742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68008-14f6-432c-b3b3-5f58adec6400 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:35.795169 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68008-14f6-432c-b3b3-5f58adec6400 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:35.797080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:35.837099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabf003-47aa-40c7-98b4-e8ef5b4fd73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:35.837751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf003-47aa-40c7-98b4-e8ef5b4fd73d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:35.838034 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf003-47aa-40c7-98b4-e8ef5b4fd73d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:35.838305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf003-47aa-40c7-98b4-e8ef5b4fd73d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:35.846103 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabf003-47aa-40c7-98b4-e8ef5b4fd73d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:35.847915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabf003-47aa-40c7-98b4-e8ef5b4fd73d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-7fabf003-47aa-40c7-98b4-e8ef5b4fd73d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:35.860382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:35.861382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:35.862419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:35.862419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:35.862419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:35.862419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:35.862419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:35.862419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:35.862419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:35.862419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:35.862419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:35.862419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:35.862419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 590/1212] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:35.868668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a147b4-e3cf-4f48-9bb8-7cb274ae8a35 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:35.979956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a147b4-e3cf-4f48-9bb8-7cb274ae8a35 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:36.018552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79279da-69e2-4469-841c-a44ae0265ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:36.019297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79279da-69e2-4469-841c-a44ae0265ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:36.019582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79279da-69e2-4469-841c-a44ae0265ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:36.019855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79279da-69e2-4469-841c-a44ae0265ef8 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:36.020603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79279da-69e2-4469-841c-a44ae0265ef8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:36.020945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79279da-69e2-4469-841c-a44ae0265ef8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:36.022347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79279da-69e2-4469-841c-a44ae0265ef8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:36.041235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 623/1213] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:36.047820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabf003-47aa-40c7-98b4-e8ef5b4fd73d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:36.153157 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabf003-47aa-40c7-98b4-e8ef5b4fd73d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:36.189021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8bfc2-5ca2-4516-b22b-f74390507f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:36.189630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8bfc2-5ca2-4516-b22b-f74390507f15 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:36.189913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8bfc2-5ca2-4516-b22b-f74390507f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:36.190186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8bfc2-5ca2-4516-b22b-f74390507f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:36.221112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:36.261976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8bfc2-5ca2-4516-b22b-f74390507f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:36.263755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8bfc2-5ca2-4516-b22b-f74390507f15 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:36.377798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 591/1214] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:30:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:36.383790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79279da-69e2-4469-841c-a44ae0265ef8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:36.404909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:36.488186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79279da-69e2-4469-841c-a44ae0265ef8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:36.533564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397a356-d91a-4ee9-9ce2-de9431b004fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:36.533564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a356-d91a-4ee9-9ce2-de9431b004fd None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:36.533564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a356-d91a-4ee9-9ce2-de9431b004fd None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:36.533564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397a356-d91a-4ee9-9ce2-de9431b004fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:36.542430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397a356-d91a-4ee9-9ce2-de9431b004fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:36.543948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397a356-d91a-4ee9-9ce2-de9431b004fd None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-7397a356-d91a-4ee9-9ce2-de9431b004fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:36.558384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:36.559554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:36.561070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:36.561070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:36.561070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:36.561070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 624/1215] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:36.565867 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8bfc2-5ca2-4516-b22b-f74390507f15 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:36.631566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:36.670445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8bfc2-5ca2-4516-b22b-f74390507f15 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:36.704260 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d5142-12fd-431c-9c7f-7ce1cd8ebe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:36.704884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5142-12fd-431c-9c7f-7ce1cd8ebe09 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:36.705118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5142-12fd-431c-9c7f-7ce1cd8ebe09 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:36.705386 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5142-12fd-431c-9c7f-7ce1cd8ebe09 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:36.706035 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d5142-12fd-431c-9c7f-7ce1cd8ebe09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:36.706329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d5142-12fd-431c-9c7f-7ce1cd8ebe09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:36.707859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d5142-12fd-431c-9c7f-7ce1cd8ebe09 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:36.721060 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 592/1216] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:36.727095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397a356-d91a-4ee9-9ce2-de9431b004fd None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:36.802413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:36.834862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397a356-d91a-4ee9-9ce2-de9431b004fd None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:36.873357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02452cb-74d3-4333-bdb2-ef571bde687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:36.873999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02452cb-74d3-4333-bdb2-ef571bde687c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:36.874271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02452cb-74d3-4333-bdb2-ef571bde687c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:36.874540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02452cb-74d3-4333-bdb2-ef571bde687c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:36.881673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02452cb-74d3-4333-bdb2-ef571bde687c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:36.886922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02452cb-74d3-4333-bdb2-ef571bde687c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-a02452cb-74d3-4333-bdb2-ef571bde687c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:36.894208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:36.895191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:36.896117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:36.896117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:36.896117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:36.896117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:36.896117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:36.896117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:36.896117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:36.896117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:36.896117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 625/1217] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:36.901392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d5142-12fd-431c-9c7f-7ce1cd8ebe09 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:37.006115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d5142-12fd-431c-9c7f-7ce1cd8ebe09 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:37.029826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:37.041368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727e1f8-db6c-4be8-819c-104c97443fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:37.042008 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727e1f8-db6c-4be8-819c-104c97443fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:37.042288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727e1f8-db6c-4be8-819c-104c97443fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:37.042562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727e1f8-db6c-4be8-819c-104c97443fe1 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:37.043299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727e1f8-db6c-4be8-819c-104c97443fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:37.043609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727e1f8-db6c-4be8-819c-104c97443fe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:37.045712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727e1f8-db6c-4be8-819c-104c97443fe1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:37.060757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 593/1218] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:37.067228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02452cb-74d3-4333-bdb2-ef571bde687c None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:37.173698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02452cb-74d3-4333-bdb2-ef571bde687c None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:37.204077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:37.210448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf28001-f716-41dd-b8d1-a5d6b2325650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:37.211109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf28001-f716-41dd-b8d1-a5d6b2325650 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:37.211398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf28001-f716-41dd-b8d1-a5d6b2325650 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:37.211669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf28001-f716-41dd-b8d1-a5d6b2325650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:37.212414 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf28001-f716-41dd-b8d1-a5d6b2325650 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=e686e974721345eba4de46cde2edaf34) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:37.212718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf28001-f716-41dd-b8d1-a5d6b2325650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:37.214193 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf28001-f716-41dd-b8d1-a5d6b2325650 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:37.223216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 626/1219] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:30:37 2022] GET /identity/v3/role_assignments?user.id=e686e974721345eba4de46cde2edaf34&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:39.115068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1537a2-91b2-4cce-801c-860269a7c00c None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:39.115632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1537a2-91b2-4cce-801c-860269a7c00c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:39.115632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1537a2-91b2-4cce-801c-860269a7c00c None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:39.117210 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 594/1220] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:39.122445 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29abc6-cf21-4298-a28a-c6bacce5543d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:39.123468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29abc6-cf21-4298-a28a-c6bacce5543d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:39.123579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29abc6-cf21-4298-a28a-c6bacce5543d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:39.141379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7e29abc6-cf21-4298-a28a-c6bacce5543d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:39.142574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7e29abc6-cf21-4298-a28a-c6bacce5543d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:39.213177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 627/1221] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:39.483242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1537a2-91b2-4cce-801c-860269a7c00c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:39.592148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1537a2-91b2-4cce-801c-860269a7c00c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:39.627315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688bd3a-f7a2-4939-a246-d1278bb1da7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:39.627944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688bd3a-f7a2-4939-a246-d1278bb1da7f None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:39.628226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688bd3a-f7a2-4939-a246-d1278bb1da7f None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:39.628500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688bd3a-f7a2-4939-a246-d1278bb1da7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:39.639328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688bd3a-f7a2-4939-a246-d1278bb1da7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f688bd3a-f7a2-4939-a246-d1278bb1da7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:39.644137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:39.645263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:39.646171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 595/1222] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:30:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:39.651455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29abc6-cf21-4298-a28a-c6bacce5543d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:39.750655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29abc6-cf21-4298-a28a-c6bacce5543d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:39.775451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:39.786887 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd400b74-8dd0-44c9-b45a-7474af816d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:39.787568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd400b74-8dd0-44c9-b45a-7474af816d79 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:39.787870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd400b74-8dd0-44c9-b45a-7474af816d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:39.788153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd400b74-8dd0-44c9-b45a-7474af816d79 None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:39.788853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd400b74-8dd0-44c9-b45a-7474af816d79 None admin] RBAC: Adding query filter params (name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:39.789170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd400b74-8dd0-44c9-b45a-7474af816d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:39.790619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd400b74-8dd0-44c9-b45a-7474af816d79 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:39.798602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 628/1223] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:30:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:39.804579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688bd3a-f7a2-4939-a246-d1278bb1da7f None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:39.849767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:39.906517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688bd3a-f7a2-4939-a246-d1278bb1da7f None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:39.941167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f536b41-52cd-486c-9851-567919ba1274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:39.941842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f536b41-52cd-486c-9851-567919ba1274 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:39.942119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f536b41-52cd-486c-9851-567919ba1274 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:39.942393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f536b41-52cd-486c-9851-567919ba1274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:39.953649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f536b41-52cd-486c-9851-567919ba1274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:39.955171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f536b41-52cd-486c-9851-567919ba1274 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-0f536b41-52cd-486c-9851-567919ba1274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:39.971985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:39.973423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:39.974577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:39.974577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:39.974577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:39.974577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 596/1224] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:39.979936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd400b74-8dd0-44c9-b45a-7474af816d79 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:40.079210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd400b74-8dd0-44c9-b45a-7474af816d79 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:40.112266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b9dc5-2c1f-4b4c-b082-89762879a1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:40.112916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b9dc5-2c1f-4b4c-b082-89762879a1ca None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:40.113218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b9dc5-2c1f-4b4c-b082-89762879a1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:40.113509 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b9dc5-2c1f-4b4c-b082-89762879a1ca None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:40.114180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b9dc5-2c1f-4b4c-b082-89762879a1ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:40.114506 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b9dc5-2c1f-4b4c-b082-89762879a1ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:40.115975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b9dc5-2c1f-4b4c-b082-89762879a1ca None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:40.128580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 629/1225] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:40.134479 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f536b41-52cd-486c-9851-567919ba1274 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:40.231465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:40.238071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f536b41-52cd-486c-9851-567919ba1274 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:40.272807 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38206150-6684-4073-8d54-6d55dc5e3286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:40.273459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38206150-6684-4073-8d54-6d55dc5e3286 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:40.273760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38206150-6684-4073-8d54-6d55dc5e3286 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:40.274055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38206150-6684-4073-8d54-6d55dc5e3286 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:40.281273 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38206150-6684-4073-8d54-6d55dc5e3286 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:40.286642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38206150-6684-4073-8d54-6d55dc5e3286 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-38206150-6684-4073-8d54-6d55dc5e3286 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:40.294763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:40.295776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:40.296826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:40.296826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:40.296826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:40.296826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:40.296826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:40.296826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:40.296826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:40.296826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:40.296826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:40.296826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:40.296826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 597/1226] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:40.301836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b9dc5-2c1f-4b4c-b082-89762879a1ca None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:40.349206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:40.400887 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b9dc5-2c1f-4b4c-b082-89762879a1ca None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:40.434055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e959c-1093-4bf1-bc54-4e3547377261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:40.434663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e959c-1093-4bf1-bc54-4e3547377261 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:40.434966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e959c-1093-4bf1-bc54-4e3547377261 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:40.435831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e959c-1093-4bf1-bc54-4e3547377261 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:40.436609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e959c-1093-4bf1-bc54-4e3547377261 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:40.436918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e959c-1093-4bf1-bc54-4e3547377261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:40.438424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e959c-1093-4bf1-bc54-4e3547377261 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:40.455387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 630/1227] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:40.461172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38206150-6684-4073-8d54-6d55dc5e3286 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:40.564776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38206150-6684-4073-8d54-6d55dc5e3286 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:40.601166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d2ed9-3658-4cc0-b7d0-c71cab3b8f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:40.601731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d2ed9-3658-4cc0-b7d0-c71cab3b8f15 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:40.602016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d2ed9-3658-4cc0-b7d0-c71cab3b8f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:40.602293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d2ed9-3658-4cc0-b7d0-c71cab3b8f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:40.614578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d2ed9-3658-4cc0-b7d0-c71cab3b8f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:40.616181 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d2ed9-3658-4cc0-b7d0-c71cab3b8f15 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-d56d2ed9-3658-4cc0-b7d0-c71cab3b8f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:40.632236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:40.633445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:40.634530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:40.634530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:40.634530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:40.634530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 598/1228] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:40.639510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e959c-1093-4bf1-bc54-4e3547377261 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:40.744464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e959c-1093-4bf1-bc54-4e3547377261 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:40.746810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:40.780040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c18a0-a5a6-4cd2-a3ee-e79ae9e4ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:40.780687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c18a0-a5a6-4cd2-a3ee-e79ae9e4ef25 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:40.781087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c18a0-a5a6-4cd2-a3ee-e79ae9e4ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:40.781361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c18a0-a5a6-4cd2-a3ee-e79ae9e4ef25 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:40.782018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c18a0-a5a6-4cd2-a3ee-e79ae9e4ef25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:40.782324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c18a0-a5a6-4cd2-a3ee-e79ae9e4ef25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:40.783748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c18a0-a5a6-4cd2-a3ee-e79ae9e4ef25 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:40.796320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 631/1229] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:40.802050 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d2ed9-3658-4cc0-b7d0-c71cab3b8f15 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:40.812779 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:40.902921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d2ed9-3658-4cc0-b7d0-c71cab3b8f15 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:40.936964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469d563-1d35-4bda-9eb5-9c7e1e75992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:40.937592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469d563-1d35-4bda-9eb5-9c7e1e75992e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:40.937875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469d563-1d35-4bda-9eb5-9c7e1e75992e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:40.938150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469d563-1d35-4bda-9eb5-9c7e1e75992e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:40.944641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469d563-1d35-4bda-9eb5-9c7e1e75992e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:40.946086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469d563-1d35-4bda-9eb5-9c7e1e75992e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-2469d563-1d35-4bda-9eb5-9c7e1e75992e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:40.957153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:40.958211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:40.959529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:40.959529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:40.959529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:40.959529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:40.959529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:40.959529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:40.959529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:40.959529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:40.959529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 599/1230] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:40.964269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c18a0-a5a6-4cd2-a3ee-e79ae9e4ef25 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:41.068851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c18a0-a5a6-4cd2-a3ee-e79ae9e4ef25 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:41.112275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bc51b-5e6c-402d-b12d-7c5e371cb38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:41.112893 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bc51b-5e6c-402d-b12d-7c5e371cb38c None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:41.113202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bc51b-5e6c-402d-b12d-7c5e371cb38c None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:41.113481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bc51b-5e6c-402d-b12d-7c5e371cb38c None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:41.114184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bc51b-5e6c-402d-b12d-7c5e371cb38c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:41.114502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bc51b-5e6c-402d-b12d-7c5e371cb38c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:41.116014 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bc51b-5e6c-402d-b12d-7c5e371cb38c None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:41.130821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 632/1231] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:41.134922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469d563-1d35-4bda-9eb5-9c7e1e75992e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:41.201585 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:41.237664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469d563-1d35-4bda-9eb5-9c7e1e75992e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:41.271497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f67127-b265-432f-b127-7b8388c67bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:41.272164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67127-b265-432f-b127-7b8388c67bbc None admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:41.272473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67127-b265-432f-b127-7b8388c67bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:41.272766 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67127-b265-432f-b127-7b8388c67bbc None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/e686e974721345eba4de46cde2edaf34/roles/09f0dc52983d44cfad84d8c3c4fc4384` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:41.286916 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f67127-b265-432f-b127-7b8388c67bbc None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=e686e974721345eba4de46cde2edaf34, role_id=09f0dc52983d44cfad84d8c3c4fc4384)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:41.288445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f67127-b265-432f-b127-7b8388c67bbc None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:41.490088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 600/1232] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:30:41 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/e686e974721345eba4de46cde2edaf34/roles/09f0dc52983d44cfad84d8c3c4fc4384 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:30:43.371398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc4db-42c0-4d12-83cb-0f312cc7405c None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:43.371942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc4db-42c0-4d12-83cb-0f312cc7405c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:43.372093 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc4db-42c0-4d12-83cb-0f312cc7405c None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:43.373765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 633/1233] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:30:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:30:43.379981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917a16c-ca33-423b-b41c-b7e3b24ebb56 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:43.385584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917a16c-ca33-423b-b41c-b7e3b24ebb56 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:43.385584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917a16c-ca33-423b-b41c-b7e3b24ebb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:43.398805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6917a16c-ca33-423b-b41c-b7e3b24ebb56 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:43.400116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6917a16c-ca33-423b-b41c-b7e3b24ebb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:43.468738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 601/1234] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:43.734155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bc4db-42c0-4d12-83cb-0f312cc7405c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:43.759606 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:43.836177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bc4db-42c0-4d12-83cb-0f312cc7405c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:43.871628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb9a07-5c54-40b4-a22b-2cf5e3bcab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:43.872266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb9a07-5c54-40b4-a22b-2cf5e3bcab05 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:43.873049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb9a07-5c54-40b4-a22b-2cf5e3bcab05 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:43.873325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb9a07-5c54-40b4-a22b-2cf5e3bcab05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:43.883383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb9a07-5c54-40b4-a22b-2cf5e3bcab05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-1cfb9a07-5c54-40b4-a22b-2cf5e3bcab05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:43.888711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:43.889815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:43.891036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 634/1235] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 03:30:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:43.895963 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917a16c-ca33-423b-b41c-b7e3b24ebb56 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:43.943536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:43.997794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917a16c-ca33-423b-b41c-b7e3b24ebb56 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:44.032286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5c58d-a395-43d7-86b2-7e19a24f07c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:44.032908 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5c58d-a395-43d7-86b2-7e19a24f07c4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:44.033213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5c58d-a395-43d7-86b2-7e19a24f07c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:44.033490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5c58d-a395-43d7-86b2-7e19a24f07c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:44.034191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5c58d-a395-43d7-86b2-7e19a24f07c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:44.034498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5c58d-a395-43d7-86b2-7e19a24f07c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:44.035966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5c58d-a395-43d7-86b2-7e19a24f07c4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:44.043965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 602/1236] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 03:30:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:44.050432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb9a07-5c54-40b4-a22b-2cf5e3bcab05 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:44.137232 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:44.153287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb9a07-5c54-40b4-a22b-2cf5e3bcab05 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:44.186846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865df7-3852-4cd2-80cc-3692015b5697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:44.187507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865df7-3852-4cd2-80cc-3692015b5697 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:44.187788 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865df7-3852-4cd2-80cc-3692015b5697 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:44.188061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865df7-3852-4cd2-80cc-3692015b5697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:44.197671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43865df7-3852-4cd2-80cc-3692015b5697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:44.199158 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43865df7-3852-4cd2-80cc-3692015b5697 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-43865df7-3852-4cd2-80cc-3692015b5697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:44.216752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:44.222817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:44.223969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:44.223969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:44.223969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:44.223969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 635/1237] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:44.224250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5c58d-a395-43d7-86b2-7e19a24f07c4 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:44.332328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5c58d-a395-43d7-86b2-7e19a24f07c4 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:44.341670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:44.366142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2219cc5-d274-460a-b907-4283682832c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:44.366745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2219cc5-d274-460a-b907-4283682832c2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:44.367023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2219cc5-d274-460a-b907-4283682832c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:44.367341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2219cc5-d274-460a-b907-4283682832c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:44.367969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2219cc5-d274-460a-b907-4283682832c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:44.368272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2219cc5-d274-460a-b907-4283682832c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:44.369636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2219cc5-d274-460a-b907-4283682832c2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:44.381133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 603/1238] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:44.386983 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865df7-3852-4cd2-80cc-3692015b5697 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:44.489393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865df7-3852-4cd2-80cc-3692015b5697 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:44.523032 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937b85-6986-4029-9a8f-eebf64af8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:44.523683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937b85-6986-4029-9a8f-eebf64af8bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:44.523963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937b85-6986-4029-9a8f-eebf64af8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:44.524235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86937b85-6986-4029-9a8f-eebf64af8bd0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:44.526821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:44.531647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86937b85-6986-4029-9a8f-eebf64af8bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:44.533116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86937b85-6986-4029-9a8f-eebf64af8bd0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-86937b85-6986-4029-9a8f-eebf64af8bd0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:44.544325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:44.545327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:44.546393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:44.546393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:44.546393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:44.546393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:44.546393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:44.546393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:44.546393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:44.546393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:44.546393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:44.546393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:44.546393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 636/1239] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:44.551429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2219cc5-d274-460a-b907-4283682832c2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:44.650907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2219cc5-d274-460a-b907-4283682832c2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:44.688383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984385c7-de8f-43b0-ab54-f393f29e7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:44.688999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984385c7-de8f-43b0-ab54-f393f29e7e4b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:44.689280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984385c7-de8f-43b0-ab54-f393f29e7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:44.689551 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984385c7-de8f-43b0-ab54-f393f29e7e4b None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:44.690288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984385c7-de8f-43b0-ab54-f393f29e7e4b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:44.690595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984385c7-de8f-43b0-ab54-f393f29e7e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:44.692054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984385c7-de8f-43b0-ab54-f393f29e7e4b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:44.710639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 604/1240] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:44.716528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937b85-6986-4029-9a8f-eebf64af8bd0 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:44.814772 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86937b85-6986-4029-9a8f-eebf64af8bd0 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:44.848548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3af05-0458-4857-99ea-3a06a9802dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:44.849149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3af05-0458-4857-99ea-3a06a9802dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:44.849423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3af05-0458-4857-99ea-3a06a9802dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:44.849693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3af05-0458-4857-99ea-3a06a9802dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:44.909852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:44.916191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3af05-0458-4857-99ea-3a06a9802dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:44.917653 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3af05-0458-4857-99ea-3a06a9802dc8 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:45.021954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 637/1241] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:30:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:30:45.028757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984385c7-de8f-43b0-ab54-f393f29e7e4b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:45.062154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:45.133899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984385c7-de8f-43b0-ab54-f393f29e7e4b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:45.166557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dea0b-8e50-4110-9ead-dee592eebe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:45.167140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dea0b-8e50-4110-9ead-dee592eebe29 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:45.167424 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dea0b-8e50-4110-9ead-dee592eebe29 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:45.167756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dea0b-8e50-4110-9ead-dee592eebe29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:45.178121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45dea0b-8e50-4110-9ead-dee592eebe29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:45.179730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45dea0b-8e50-4110-9ead-dee592eebe29 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c45dea0b-8e50-4110-9ead-dee592eebe29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:45.195617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:45.196791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:45.197944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:45.197944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:45.197944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:45.197944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 605/1242] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:30:45.202649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3af05-0458-4857-99ea-3a06a9802dc8 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:45.296856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:45.302852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3af05-0458-4857-99ea-3a06a9802dc8 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:45.337279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724932aa-0188-4b38-ae0b-5e54785e145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:45.337880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724932aa-0188-4b38-ae0b-5e54785e145a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:45.338156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724932aa-0188-4b38-ae0b-5e54785e145a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:45.338423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724932aa-0188-4b38-ae0b-5e54785e145a None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:45.339196 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724932aa-0188-4b38-ae0b-5e54785e145a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:45.339497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724932aa-0188-4b38-ae0b-5e54785e145a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:45.341385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724932aa-0188-4b38-ae0b-5e54785e145a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:45.354112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 638/1243] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:45.363876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dea0b-8e50-4110-9ead-dee592eebe29 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:45.445496 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:45.466385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dea0b-8e50-4110-9ead-dee592eebe29 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:45.500354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2948e-3bd5-4275-a8ab-26167f8ea44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:45.500976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2948e-3bd5-4275-a8ab-26167f8ea44b None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:45.501261 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2948e-3bd5-4275-a8ab-26167f8ea44b None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:45.501539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2948e-3bd5-4275-a8ab-26167f8ea44b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:45.508890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2948e-3bd5-4275-a8ab-26167f8ea44b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:45.510339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2948e-3bd5-4275-a8ab-26167f8ea44b None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-74e2948e-3bd5-4275-a8ab-26167f8ea44b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:45.521753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:45.522712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:45.523816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:45.523816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:45.523816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:45.523816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:45.523816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:45.523816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:45.523816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:45.523816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:45.523816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 606/1244] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:45.529452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724932aa-0188-4b38-ae0b-5e54785e145a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:45.630076 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724932aa-0188-4b38-ae0b-5e54785e145a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:45.663635 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e9f05-3347-423e-b856-5c33873681a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:45.664238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e9f05-3347-423e-b856-5c33873681a7 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:45.664535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e9f05-3347-423e-b856-5c33873681a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:45.664863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e9f05-3347-423e-b856-5c33873681a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:45.665554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e9f05-3347-423e-b856-5c33873681a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:45.665899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e9f05-3347-423e-b856-5c33873681a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:45.667357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e9f05-3347-423e-b856-5c33873681a7 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:45.679343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 639/1245] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:45.685566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2948e-3bd5-4275-a8ab-26167f8ea44b None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:45.785088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2948e-3bd5-4275-a8ab-26167f8ea44b None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:45.818289 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0306e4-836f-4651-8ae5-33a49982ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:45.818911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0306e4-836f-4651-8ae5-33a49982ed33 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:45.819226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0306e4-836f-4651-8ae5-33a49982ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:45.819500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0306e4-836f-4651-8ae5-33a49982ed33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:45.820257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0306e4-836f-4651-8ae5-33a49982ed33 None admin] RBAC: Adding query filter params (role.id=09f0dc52983d44cfad84d8c3c4fc4384, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=e686e974721345eba4de46cde2edaf34) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:45.820568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0306e4-836f-4651-8ae5-33a49982ed33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:45.821997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0306e4-836f-4651-8ae5-33a49982ed33 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:45.828457 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 607/1246] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:30:45 2022] GET /identity/v3/role_assignments?user.id=e686e974721345eba4de46cde2edaf34&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=09f0dc52983d44cfad84d8c3c4fc4384 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:47.793277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d67e2e-1855-45d9-8116-14330c169636 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:47.793808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d67e2e-1855-45d9-8116-14330c169636 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:47.793808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d67e2e-1855-45d9-8116-14330c169636 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:47.795224 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 640/1247] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:47.800410 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693baff6-4381-4f20-93ae-22a420127cc8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:47.800813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693baff6-4381-4f20-93ae-22a420127cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:47.800965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693baff6-4381-4f20-93ae-22a420127cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:47.807235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:47.819720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-693baff6-4381-4f20-93ae-22a420127cc8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:47.820938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-693baff6-4381-4f20-93ae-22a420127cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:47.886892 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 608/1248] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:48.154300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d67e2e-1855-45d9-8116-14330c169636 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:48.172905 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:48.255581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d67e2e-1855-45d9-8116-14330c169636 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:48.291198 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e2027-ea2c-443c-92ee-676796d1a724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:48.291833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e2027-ea2c-443c-92ee-676796d1a724 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:48.292114 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e2027-ea2c-443c-92ee-676796d1a724 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:48.292387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e2027-ea2c-443c-92ee-676796d1a724 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:48.303255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e2027-ea2c-443c-92ee-676796d1a724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-735e2027-ea2c-443c-92ee-676796d1a724 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:48.307970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:48.308931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:48.309908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 641/1249] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:30:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:48.315215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693baff6-4381-4f20-93ae-22a420127cc8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:48.413106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693baff6-4381-4f20-93ae-22a420127cc8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:48.442202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:48.447186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5214-c571-4763-b70e-2f32dd777ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:48.447792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5214-c571-4763-b70e-2f32dd777ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:48.448077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5214-c571-4763-b70e-2f32dd777ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:48.448384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5214-c571-4763-b70e-2f32dd777ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:48.449056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5214-c571-4763-b70e-2f32dd777ca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:48.449363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5214-c571-4763-b70e-2f32dd777ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:48.451309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5214-c571-4763-b70e-2f32dd777ca0 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:48.459206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 609/1250] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:30:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:48.465408 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e2027-ea2c-443c-92ee-676796d1a724 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:48.543107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:48.565784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e2027-ea2c-443c-92ee-676796d1a724 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:48.598433 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb34ee-e048-4cc8-9184-7f44240ccbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:48.599074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb34ee-e048-4cc8-9184-7f44240ccbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:48.599368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb34ee-e048-4cc8-9184-7f44240ccbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:48.599639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb34ee-e048-4cc8-9184-7f44240ccbd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:48.610264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb34ee-e048-4cc8-9184-7f44240ccbd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:48.611769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb34ee-e048-4cc8-9184-7f44240ccbd3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-87eb34ee-e048-4cc8-9184-7f44240ccbd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:48.626686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:48.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:48.629025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:48.629025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:48.629025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:48.629025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 642/1251] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:48.633861 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5214-c571-4763-b70e-2f32dd777ca0 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:48.732145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5214-c571-4763-b70e-2f32dd777ca0 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:48.765412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797610a-6034-4b19-a23f-539a70701955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:48.766027 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797610a-6034-4b19-a23f-539a70701955 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:48.766310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797610a-6034-4b19-a23f-539a70701955 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:48.766586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797610a-6034-4b19-a23f-539a70701955 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:48.767258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797610a-6034-4b19-a23f-539a70701955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:48.767564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797610a-6034-4b19-a23f-539a70701955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:48.768939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797610a-6034-4b19-a23f-539a70701955 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:48.780486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 610/1252] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:48.786307 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb34ee-e048-4cc8-9184-7f44240ccbd3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:48.887591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb34ee-e048-4cc8-9184-7f44240ccbd3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:48.912909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:48.921015 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b790e1-4159-45d3-9bb2-3d50f03d2e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:48.921644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b790e1-4159-45d3-9bb2-3d50f03d2e64 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:48.921923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b790e1-4159-45d3-9bb2-3d50f03d2e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:48.922194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b790e1-4159-45d3-9bb2-3d50f03d2e64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:48.929419 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b790e1-4159-45d3-9bb2-3d50f03d2e64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:48.933098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b790e1-4159-45d3-9bb2-3d50f03d2e64 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-80b790e1-4159-45d3-9bb2-3d50f03d2e64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:48.942229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:48.943410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:48.944421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:48.944421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:48.944421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:48.944421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:48.944421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:48.944421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:48.944421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:48.944421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:48.944421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:48.944421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:48.944421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 643/1253] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:48.949202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797610a-6034-4b19-a23f-539a70701955 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:49.004060 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:49.048364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797610a-6034-4b19-a23f-539a70701955 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:49.082188 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4524b-22f1-4673-a045-7dea56fdfbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:49.082822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4524b-22f1-4673-a045-7dea56fdfbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:49.083136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4524b-22f1-4673-a045-7dea56fdfbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:49.083413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4524b-22f1-4673-a045-7dea56fdfbc7 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:49.084148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4524b-22f1-4673-a045-7dea56fdfbc7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:49.084456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4524b-22f1-4673-a045-7dea56fdfbc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:49.085889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4524b-22f1-4673-a045-7dea56fdfbc7 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:49.103088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 611/1254] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:49.108824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b790e1-4159-45d3-9bb2-3d50f03d2e64 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:49.207400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b790e1-4159-45d3-9bb2-3d50f03d2e64 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:49.240274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35a190-eeae-4394-bd67-8e75ec0989c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:49.240886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35a190-eeae-4394-bd67-8e75ec0989c4 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:49.241167 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35a190-eeae-4394-bd67-8e75ec0989c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:49.241441 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35a190-eeae-4394-bd67-8e75ec0989c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:49.297541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:49.310703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35a190-eeae-4394-bd67-8e75ec0989c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:49.312214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35a190-eeae-4394-bd67-8e75ec0989c4 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:49.409339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 644/1255] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:30:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:49.415288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4524b-22f1-4673-a045-7dea56fdfbc7 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:49.519692 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4524b-22f1-4673-a045-7dea56fdfbc7 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:49.533420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:49.553759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bb911-9807-4af7-ae2a-dc9c3fefcb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:49.554318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bb911-9807-4af7-ae2a-dc9c3fefcb6e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:49.554595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bb911-9807-4af7-ae2a-dc9c3fefcb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:49.554867 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bb911-9807-4af7-ae2a-dc9c3fefcb6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:49.564808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bb911-9807-4af7-ae2a-dc9c3fefcb6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:49.566248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bb911-9807-4af7-ae2a-dc9c3fefcb6e None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-533bb911-9807-4af7-ae2a-dc9c3fefcb6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:49.580925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:49.582013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:49.582929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:49.582929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:49.582929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:49.582929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 612/1256] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:49.588021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35a190-eeae-4394-bd67-8e75ec0989c4 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:49.674617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:49.687183 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35a190-eeae-4394-bd67-8e75ec0989c4 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:49.721056 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61d672-7372-4e73-bc43-0cb8f8fed421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:49.721667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61d672-7372-4e73-bc43-0cb8f8fed421 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:49.722311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61d672-7372-4e73-bc43-0cb8f8fed421 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:49.722539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61d672-7372-4e73-bc43-0cb8f8fed421 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:49.723223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61d672-7372-4e73-bc43-0cb8f8fed421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:49.723532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61d672-7372-4e73-bc43-0cb8f8fed421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:49.724922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61d672-7372-4e73-bc43-0cb8f8fed421 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:49.736666 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 645/1257] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:49.742431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bb911-9807-4af7-ae2a-dc9c3fefcb6e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:49.850577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bb911-9807-4af7-ae2a-dc9c3fefcb6e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:49.884311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1b841-c309-43bf-9f9c-48982fa1c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:49.884934 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b841-c309-43bf-9f9c-48982fa1c761 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:49.885209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b841-c309-43bf-9f9c-48982fa1c761 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:49.885476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b841-c309-43bf-9f9c-48982fa1c761 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:49.891931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1b841-c309-43bf-9f9c-48982fa1c761 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:49.893406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1b841-c309-43bf-9f9c-48982fa1c761 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-6ae1b841-c309-43bf-9f9c-48982fa1c761 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:49.905170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:49.906225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:49.907370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:49.907370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:49.907370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:49.907370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:49.907370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:49.907370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:49.907370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:49.907370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:49.907370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 613/1258] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:49.912666 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61d672-7372-4e73-bc43-0cb8f8fed421 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:50.017383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61d672-7372-4e73-bc43-0cb8f8fed421 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:50.050696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd13ba0-da02-405b-a991-7f2cf3a89b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:50.051334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd13ba0-da02-405b-a991-7f2cf3a89b26 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:50.051618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd13ba0-da02-405b-a991-7f2cf3a89b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:50.051892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd13ba0-da02-405b-a991-7f2cf3a89b26 None admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:50.052581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd13ba0-da02-405b-a991-7f2cf3a89b26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:50.052889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd13ba0-da02-405b-a991-7f2cf3a89b26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:50.054349 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd13ba0-da02-405b-a991-7f2cf3a89b26 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:50.066650 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 646/1259] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:50.072737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1b841-c309-43bf-9f9c-48982fa1c761 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:50.110457 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:50.176926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1b841-c309-43bf-9f9c-48982fa1c761 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:50.209823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4216e5c-bf46-4aeb-8f87-c2af65ca0807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:50.210424 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4216e5c-bf46-4aeb-8f87-c2af65ca0807 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:50.210704 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4216e5c-bf46-4aeb-8f87-c2af65ca0807 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:50.210976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4216e5c-bf46-4aeb-8f87-c2af65ca0807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:50.211727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4216e5c-bf46-4aeb-8f87-c2af65ca0807 None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=e686e974721345eba4de46cde2edaf34) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:50.212036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4216e5c-bf46-4aeb-8f87-c2af65ca0807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:50.213457 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4216e5c-bf46-4aeb-8f87-c2af65ca0807 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:50.219622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 614/1260] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:30:50 2022] GET /identity/v3/role_assignments?user.id=e686e974721345eba4de46cde2edaf34&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:52.118957 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd286f0-908a-4547-a627-ef10474e8a78 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:52.119511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd286f0-908a-4547-a627-ef10474e8a78 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:52.119511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd286f0-908a-4547-a627-ef10474e8a78 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:52.120812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 647/1261] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:52.126540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe03ca2-a3ac-4fd1-8cbd-6412bbe0dd61 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:52.126955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe03ca2-a3ac-4fd1-8cbd-6412bbe0dd61 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:52.128517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe03ca2-a3ac-4fd1-8cbd-6412bbe0dd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:52.145606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1fe03ca2-a3ac-4fd1-8cbd-6412bbe0dd61 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:52.146788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1fe03ca2-a3ac-4fd1-8cbd-6412bbe0dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:52.213002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 615/1262] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:52.486812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd286f0-908a-4547-a627-ef10474e8a78 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:52.498336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:52.590964 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd286f0-908a-4547-a627-ef10474e8a78 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:52.624472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf467206-196e-46b0-93fa-dcc7ff4aae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:52.625105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf467206-196e-46b0-93fa-dcc7ff4aae53 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:52.625384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf467206-196e-46b0-93fa-dcc7ff4aae53 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:52.625661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf467206-196e-46b0-93fa-dcc7ff4aae53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:52.635454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf467206-196e-46b0-93fa-dcc7ff4aae53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-bf467206-196e-46b0-93fa-dcc7ff4aae53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:52.640180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:52.641300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:52.642355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 648/1263] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:30:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:52.647503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe03ca2-a3ac-4fd1-8cbd-6412bbe0dd61 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:52.665506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:52.743429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe03ca2-a3ac-4fd1-8cbd-6412bbe0dd61 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:52.775978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061af21-fca9-4c48-b837-1b433375fa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:52.776575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061af21-fca9-4c48-b837-1b433375fa05 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:52.776856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061af21-fca9-4c48-b837-1b433375fa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:52.777130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061af21-fca9-4c48-b837-1b433375fa05 None admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:52.777793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061af21-fca9-4c48-b837-1b433375fa05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:52.778622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061af21-fca9-4c48-b837-1b433375fa05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:52.780037 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061af21-fca9-4c48-b837-1b433375fa05 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:52.787776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 616/1264] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:30:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:52.794249 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf467206-196e-46b0-93fa-dcc7ff4aae53 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:52.862928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:52.896037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf467206-196e-46b0-93fa-dcc7ff4aae53 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:52.929313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c864c9-5171-438e-a104-732d992a643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:52.929948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c864c9-5171-438e-a104-732d992a643b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:52.930238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c864c9-5171-438e-a104-732d992a643b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:52.930514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c864c9-5171-438e-a104-732d992a643b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:52.940698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c864c9-5171-438e-a104-732d992a643b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:52.942172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c864c9-5171-438e-a104-732d992a643b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-b5c864c9-5171-438e-a104-732d992a643b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:52.955833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:52.956986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:52.958034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:52.958034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:52.958034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:52.958034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 649/1265] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:52.963078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061af21-fca9-4c48-b837-1b433375fa05 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:53.042107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:53.060685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061af21-fca9-4c48-b837-1b433375fa05 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:53.093180 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977e536-da62-4016-92be-382f51a103db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:53.093808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e536-da62-4016-92be-382f51a103db None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:53.094096 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e536-da62-4016-92be-382f51a103db None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:53.094376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e536-da62-4016-92be-382f51a103db None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:53.095028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977e536-da62-4016-92be-382f51a103db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:53.095367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977e536-da62-4016-92be-382f51a103db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:53.097082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977e536-da62-4016-92be-382f51a103db None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:53.108840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 617/1266] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:53.114789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c864c9-5171-438e-a104-732d992a643b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:53.223440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c864c9-5171-438e-a104-732d992a643b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:53.242330 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:53.255700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259e220-c31e-4577-a640-e6571c427f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:53.256319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259e220-c31e-4577-a640-e6571c427f46 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:53.256598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259e220-c31e-4577-a640-e6571c427f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:53.256869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259e220-c31e-4577-a640-e6571c427f46 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:53.265960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259e220-c31e-4577-a640-e6571c427f46 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:53.267421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259e220-c31e-4577-a640-e6571c427f46 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-d259e220-c31e-4577-a640-e6571c427f46 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:53.281324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:53.282533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:53.283738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:53.283738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:53.283738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:53.283738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:53.283738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:53.283738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:53.283738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:53.283738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:53.283738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:53.283738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:53.283738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 650/1267] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:53.288427 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977e536-da62-4016-92be-382f51a103db None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:53.387143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977e536-da62-4016-92be-382f51a103db None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:53.421902 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981532b9-47c1-4b0d-9278-6b3851d0c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:53.422503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981532b9-47c1-4b0d-9278-6b3851d0c985 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:53.422786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981532b9-47c1-4b0d-9278-6b3851d0c985 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:53.423083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981532b9-47c1-4b0d-9278-6b3851d0c985 None admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:53.423821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981532b9-47c1-4b0d-9278-6b3851d0c985 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:53.424129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981532b9-47c1-4b0d-9278-6b3851d0c985 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:53.425557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981532b9-47c1-4b0d-9278-6b3851d0c985 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:53.434348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:53.442330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 618/1268] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:53.449485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259e220-c31e-4577-a640-e6571c427f46 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:53.565604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259e220-c31e-4577-a640-e6571c427f46 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:53.598824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e9890-48ce-4d9a-8248-dc4edc64542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:53.599478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e9890-48ce-4d9a-8248-dc4edc64542b None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:53.599761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e9890-48ce-4d9a-8248-dc4edc64542b None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:53.600033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e9890-48ce-4d9a-8248-dc4edc64542b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:53.610342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e9890-48ce-4d9a-8248-dc4edc64542b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:53.611882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e9890-48ce-4d9a-8248-dc4edc64542b None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-231e9890-48ce-4d9a-8248-dc4edc64542b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:53.627289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:53.636904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:53.638735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:53.638735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:53.638735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:53.638735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 651/1269] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:53.639129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981532b9-47c1-4b0d-9278-6b3851d0c985 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:53.732606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981532b9-47c1-4b0d-9278-6b3851d0c985 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:53.765139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1201f-01af-4796-9153-c362e745e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:53.765742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1201f-01af-4796-9153-c362e745e8fd None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:53.766029 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1201f-01af-4796-9153-c362e745e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:53.766306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1201f-01af-4796-9153-c362e745e8fd None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:53.766953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1201f-01af-4796-9153-c362e745e8fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:53.767290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1201f-01af-4796-9153-c362e745e8fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:53.768658 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1201f-01af-4796-9153-c362e745e8fd None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:53.779916 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 619/1270] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:53.785611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e9890-48ce-4d9a-8248-dc4edc64542b None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:53.817942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:53.885543 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e9890-48ce-4d9a-8248-dc4edc64542b None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:53.918674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb430b-3a2d-4c20-a863-3e446dfe4041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:53.919265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb430b-3a2d-4c20-a863-3e446dfe4041 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:53.919546 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb430b-3a2d-4c20-a863-3e446dfe4041 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:53.919820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb430b-3a2d-4c20-a863-3e446dfe4041 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:53.926451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb430b-3a2d-4c20-a863-3e446dfe4041 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:53.927971 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb430b-3a2d-4c20-a863-3e446dfe4041 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-affb430b-3a2d-4c20-a863-3e446dfe4041 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:53.939291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:53.940443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:53.941418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:53.941418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:53.941418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:53.941418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:53.941418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:53.941418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:53.941418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:53.941418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:53.941418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 652/1271] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:53.946344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1201f-01af-4796-9153-c362e745e8fd None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:54.004435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:54.047205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1201f-01af-4796-9153-c362e745e8fd None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:54.080889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed92c99-e575-4a4b-885d-1f191a85dea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:54.087864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92c99-e575-4a4b-885d-1f191a85dea5 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:54.087864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92c99-e575-4a4b-885d-1f191a85dea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:54.087864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92c99-e575-4a4b-885d-1f191a85dea5 None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:54.087864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed92c99-e575-4a4b-885d-1f191a85dea5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:54.087864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed92c99-e575-4a4b-885d-1f191a85dea5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:54.087864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed92c99-e575-4a4b-885d-1f191a85dea5 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:54.097022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 620/1272] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:54.103206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb430b-3a2d-4c20-a863-3e446dfe4041 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:54.193320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:54.204677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb430b-3a2d-4c20-a863-3e446dfe4041 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:54.237990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80882d61-2fb6-421c-ba3a-d80822abc254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:54.238642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882d61-2fb6-421c-ba3a-d80822abc254 None admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:54.238923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882d61-2fb6-421c-ba3a-d80822abc254 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:54.239223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882d61-2fb6-421c-ba3a-d80822abc254 None admin] PATH_INFO: `/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/e686e974721345eba4de46cde2edaf34/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:54.241112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80882d61-2fb6-421c-ba3a-d80822abc254 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e91374ed79e432c98e3e851e544a59a, user_id=e686e974721345eba4de46cde2edaf34, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:54.242544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80882d61-2fb6-421c-ba3a-d80822abc254 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:54.523930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 653/1273] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 03:30:54 2022] PUT /identity/v3/projects/1e91374ed79e432c98e3e851e544a59a/users/e686e974721345eba4de46cde2edaf34/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:30:56.432456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e729e55-3339-4958-9bfd-535ddd6bec94 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:56.433012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e729e55-3339-4958-9bfd-535ddd6bec94 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:56.433012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e729e55-3339-4958-9bfd-535ddd6bec94 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:56.434945 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 621/1274] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:56.440066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d16f9-b62e-4d04-a299-ddd1f344f4ac None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:56.440504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d16f9-b62e-4d04-a299-ddd1f344f4ac None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:56.440603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d16f9-b62e-4d04-a299-ddd1f344f4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:56.458721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8b9d16f9-b62e-4d04-a299-ddd1f344f4ac None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:56.466840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8b9d16f9-b62e-4d04-a299-ddd1f344f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:56.527425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 654/1275] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:56.797086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e729e55-3339-4958-9bfd-535ddd6bec94 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:56.899275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e729e55-3339-4958-9bfd-535ddd6bec94 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:56.916272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:56.933013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951395-9142-469b-b10f-ecd4047f142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:56.933735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951395-9142-469b-b10f-ecd4047f142e None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:56.934050 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951395-9142-469b-b10f-ecd4047f142e None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:56.934814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951395-9142-469b-b10f-ecd4047f142e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:56.944972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8951395-9142-469b-b10f-ecd4047f142e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-f8951395-9142-469b-b10f-ecd4047f142e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:56.950425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:56.951449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:56.952514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 622/1276] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 03:30:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:56.957581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d16f9-b62e-4d04-a299-ddd1f344f4ac None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:57.038152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:57.055604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d16f9-b62e-4d04-a299-ddd1f344f4ac None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:57.088321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377bf3f-06dd-4fc5-bc94-d5bc56f55a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:57.088918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377bf3f-06dd-4fc5-bc94-d5bc56f55a1e None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:57.089199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377bf3f-06dd-4fc5-bc94-d5bc56f55a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:57.089476 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377bf3f-06dd-4fc5-bc94-d5bc56f55a1e None admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:57.090136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377bf3f-06dd-4fc5-bc94-d5bc56f55a1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:57.090995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377bf3f-06dd-4fc5-bc94-d5bc56f55a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:57.092437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377bf3f-06dd-4fc5-bc94-d5bc56f55a1e None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:57.100668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 655/1277] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 03:30:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:57.106593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951395-9142-469b-b10f-ecd4047f142e None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:57.204787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951395-9142-469b-b10f-ecd4047f142e None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:57.239165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97633732-78bc-4933-93da-7571d92df5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:57.239786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97633732-78bc-4933-93da-7571d92df5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:57.240069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97633732-78bc-4933-93da-7571d92df5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:57.240360 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97633732-78bc-4933-93da-7571d92df5c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:57.250988 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97633732-78bc-4933-93da-7571d92df5c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:57.252453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97633732-78bc-4933-93da-7571d92df5c4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-97633732-78bc-4933-93da-7571d92df5c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:57.267291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:57.269004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:57.270709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:57.270709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:57.270709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:57.270709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 623/1278] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:57.274447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377bf3f-06dd-4fc5-bc94-d5bc56f55a1e None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:57.379833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377bf3f-06dd-4fc5-bc94-d5bc56f55a1e None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:57.414144 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91330f4-be75-4b48-8b04-efc72b8c8a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:57.414746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91330f4-be75-4b48-8b04-efc72b8c8a46 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:57.415028 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91330f4-be75-4b48-8b04-efc72b8c8a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:57.415332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91330f4-be75-4b48-8b04-efc72b8c8a46 None admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:57.415976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91330f4-be75-4b48-8b04-efc72b8c8a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:57.416281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91330f4-be75-4b48-8b04-efc72b8c8a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:57.417670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91330f4-be75-4b48-8b04-efc72b8c8a46 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:57.430096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 656/1279] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:57.436327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97633732-78bc-4933-93da-7571d92df5c4 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:57.467381 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:57.542931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97633732-78bc-4933-93da-7571d92df5c4 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:57.577769 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b5dc1-7e22-4488-8f8c-67902bc85590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:57.578396 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b5dc1-7e22-4488-8f8c-67902bc85590 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:57.578677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b5dc1-7e22-4488-8f8c-67902bc85590 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:57.578952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b5dc1-7e22-4488-8f8c-67902bc85590 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:57.585827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b5dc1-7e22-4488-8f8c-67902bc85590 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:57.592632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b5dc1-7e22-4488-8f8c-67902bc85590 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-039b5dc1-7e22-4488-8f8c-67902bc85590 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:57.598869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:57.600004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:57.601195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:57.601195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:57.601195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:57.601195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:57.601195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:57.601195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:57.601195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:57.601195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:57.601195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:57.601195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:30:57.601195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 624/1280] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:57.606588 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91330f4-be75-4b48-8b04-efc72b8c8a46 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:57.610708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:57.704846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91330f4-be75-4b48-8b04-efc72b8c8a46 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:57.738552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87936f2-ebf1-43f9-8f5b-cf2d2af4bba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:57.739193 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87936f2-ebf1-43f9-8f5b-cf2d2af4bba3 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:57.739474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87936f2-ebf1-43f9-8f5b-cf2d2af4bba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:57.739742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87936f2-ebf1-43f9-8f5b-cf2d2af4bba3 None admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:57.740470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87936f2-ebf1-43f9-8f5b-cf2d2af4bba3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:57.740775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87936f2-ebf1-43f9-8f5b-cf2d2af4bba3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:57.742290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87936f2-ebf1-43f9-8f5b-cf2d2af4bba3 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:57.759418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 657/1281] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:57.765277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b5dc1-7e22-4488-8f8c-67902bc85590 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:57.857514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:57.866951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b5dc1-7e22-4488-8f8c-67902bc85590 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:57.900217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5c79b-38a2-4462-9499-37e752b0fda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:57.900812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5c79b-38a2-4462-9499-37e752b0fda2 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:57.901089 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5c79b-38a2-4462-9499-37e752b0fda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:57.901361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5c79b-38a2-4462-9499-37e752b0fda2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:57.966109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5c79b-38a2-4462-9499-37e752b0fda2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:57.967517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5c79b-38a2-4462-9499-37e752b0fda2 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:58.057167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:58.067217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 625/1282] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 03:30:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:58.073174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87936f2-ebf1-43f9-8f5b-cf2d2af4bba3 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:58.135263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:58.173955 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87936f2-ebf1-43f9-8f5b-cf2d2af4bba3 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:58.206920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311338df-9838-4ef9-a272-14f22ff1f753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:58.207616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311338df-9838-4ef9-a272-14f22ff1f753 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:58.207896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311338df-9838-4ef9-a272-14f22ff1f753 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:58.208193 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311338df-9838-4ef9-a272-14f22ff1f753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:58.218590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311338df-9838-4ef9-a272-14f22ff1f753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:58.220009 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311338df-9838-4ef9-a272-14f22ff1f753 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-311338df-9838-4ef9-a272-14f22ff1f753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:58.235289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:58.236478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:58.237429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:58.237429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:58.237429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:58.237775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 658/1283] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:30:58.242164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5c79b-38a2-4462-9499-37e752b0fda2 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:58.338743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5c79b-38a2-4462-9499-37e752b0fda2 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:58.373284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dbaee-d858-4b19-ad7a-3ec7e00e6226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:58.373880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dbaee-d858-4b19-ad7a-3ec7e00e6226 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:58.374162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dbaee-d858-4b19-ad7a-3ec7e00e6226 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:58.374437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dbaee-d858-4b19-ad7a-3ec7e00e6226 None admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:58.375099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dbaee-d858-4b19-ad7a-3ec7e00e6226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:58.375407 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dbaee-d858-4b19-ad7a-3ec7e00e6226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:58.376776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dbaee-d858-4b19-ad7a-3ec7e00e6226 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:58.388260 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 626/1284] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:58.394214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311338df-9838-4ef9-a272-14f22ff1f753 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:58.493960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311338df-9838-4ef9-a272-14f22ff1f753 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:58.507599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:58.528390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93b47d-4b48-4d2e-a44c-321078e8b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:58.529019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b47d-4b48-4d2e-a44c-321078e8b70a None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:58.529303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b47d-4b48-4d2e-a44c-321078e8b70a None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:58.529575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93b47d-4b48-4d2e-a44c-321078e8b70a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:58.536070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93b47d-4b48-4d2e-a44c-321078e8b70a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:58.537549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93b47d-4b48-4d2e-a44c-321078e8b70a None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application [None req-cb93b47d-4b48-4d2e-a44c-321078e8b70a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:58.548593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:58.549657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:58.550768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:58.550768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:58.550768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:58.550768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:58.550768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:58.550768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:58.550768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:58.550768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: ERROR keystone.server.flask.application Aug 24 03:30:58.550768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 659/1285] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:58.555722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dbaee-d858-4b19-ad7a-3ec7e00e6226 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:58.610983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:58.661124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dbaee-d858-4b19-ad7a-3ec7e00e6226 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:58.694331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8107426-24e1-4a56-95be-44e6dfdad8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:58.694909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107426-24e1-4a56-95be-44e6dfdad8ac None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:58.695219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107426-24e1-4a56-95be-44e6dfdad8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:58.695494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107426-24e1-4a56-95be-44e6dfdad8ac None admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:58.696182 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8107426-24e1-4a56-95be-44e6dfdad8ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:58.696499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8107426-24e1-4a56-95be-44e6dfdad8ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:58.697935 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8107426-24e1-4a56-95be-44e6dfdad8ac None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:58.710140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 627/1286] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:58.716828 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93b47d-4b48-4d2e-a44c-321078e8b70a None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:58.815937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93b47d-4b48-4d2e-a44c-321078e8b70a None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:58.849814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009b6e5-cfb2-4778-92d7-5a93143b6286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:58.850423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b6e5-cfb2-4778-92d7-5a93143b6286 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:58.850704 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b6e5-cfb2-4778-92d7-5a93143b6286 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:58.850980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b6e5-cfb2-4778-92d7-5a93143b6286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:58.851741 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009b6e5-cfb2-4778-92d7-5a93143b6286 None admin] RBAC: Adding query filter params (role.id=7ce3b13a76bd4874b1f4a9c205289133, scope.project.id=1e91374ed79e432c98e3e851e544a59a, user.id=e686e974721345eba4de46cde2edaf34) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:58.852052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009b6e5-cfb2-4778-92d7-5a93143b6286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:58.853613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009b6e5-cfb2-4778-92d7-5a93143b6286 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:58.859920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 660/1287] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 03:30:58 2022] GET /identity/v3/role_assignments?user.id=e686e974721345eba4de46cde2edaf34&scope.project.id=1e91374ed79e432c98e3e851e544a59a&role.id=7ce3b13a76bd4874b1f4a9c205289133 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:31:00.787900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b94238-e186-45f8-ba0e-81ef3a6efd3f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:00.788431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b94238-e186-45f8-ba0e-81ef3a6efd3f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:00.788431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b94238-e186-45f8-ba0e-81ef3a6efd3f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:00.789864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 628/1288] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:31:00.795021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43fc12-a1b0-47ae-a1b7-1f5be7d04efe None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:00.795488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43fc12-a1b0-47ae-a1b7-1f5be7d04efe None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:00.795583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43fc12-a1b0-47ae-a1b7-1f5be7d04efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:00.827913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0f43fc12-a1b0-47ae-a1b7-1f5be7d04efe None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:31:00.840969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0f43fc12-a1b0-47ae-a1b7-1f5be7d04efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:31:00.866875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:00.904304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 661/1289] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:31:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:31:01.174938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b94238-e186-45f8-ba0e-81ef3a6efd3f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:31:01.274259 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b94238-e186-45f8-ba0e-81ef3a6efd3f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:31:01.285739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:01.308198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23477eb5-0f00-44de-b2e4-f6c6af8b897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:31:01.309350 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477eb5-0f00-44de-b2e4-f6c6af8b897d None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:01.309631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477eb5-0f00-44de-b2e4-f6c6af8b897d None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:01.309905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477eb5-0f00-44de-b2e4-f6c6af8b897d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:01.310496 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23477eb5-0f00-44de-b2e4-f6c6af8b897d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:31:01.311895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23477eb5-0f00-44de-b2e4-f6c6af8b897d None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-23477eb5-0f00-44de-b2e4-f6c6af8b897d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:31:01.321028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:31:01.325933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:31:01.326806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 629/1290] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 03:31:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:31:01.329015 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43fc12-a1b0-47ae-a1b7-1f5be7d04efe None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:31:01.431008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43fc12-a1b0-47ae-a1b7-1f5be7d04efe None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:31:01.464570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2d41b-cd8a-4f29-99a0-0e4c761b25ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:31:01.465186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2d41b-cd8a-4f29-99a0-0e4c761b25ba None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:01.465493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2d41b-cd8a-4f29-99a0-0e4c761b25ba None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:01.465784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2d41b-cd8a-4f29-99a0-0e4c761b25ba None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:01.466431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2d41b-cd8a-4f29-99a0-0e4c761b25ba None admin] RBAC: Adding query filter params (name=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:31:01.466737 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2d41b-cd8a-4f29-99a0-0e4c761b25ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:31:01.468167 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2d41b-cd8a-4f29-99a0-0e4c761b25ba None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:31:01.473374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 662/1291] 10.222.0.88 () {56 vars in 1116 bytes} [Wed Aug 24 03:31:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:31:01.479389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23477eb5-0f00-44de-b2e4-f6c6af8b897d None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:31:01.580409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23477eb5-0f00-44de-b2e4-f6c6af8b897d None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:31:01.613605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4731b6-1ce1-4f5c-93ff-e798375639c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:31:01.614204 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4731b6-1ce1-4f5c-93ff-e798375639c6 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:01.614680 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4731b6-1ce1-4f5c-93ff-e798375639c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:01.614792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4731b6-1ce1-4f5c-93ff-e798375639c6 None admin] PATH_INFO: `/v3/services` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:01.615407 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4731b6-1ce1-4f5c-93ff-e798375639c6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:31:01.615717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4731b6-1ce1-4f5c-93ff-e798375639c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:31:01.617083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4731b6-1ce1-4f5c-93ff-e798375639c6 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:31:01.622027 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 630/1292] 10.222.0.88 () {56 vars in 1116 bytes} [Wed Aug 24 03:31:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:31:03.601925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50a16-7fcd-410c-8fa0-e4a3dcab531d None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:03.602499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50a16-7fcd-410c-8fa0-e4a3dcab531d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:03.602499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50a16-7fcd-410c-8fa0-e4a3dcab531d None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:03.603920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 663/1293] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:31:03.609737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a6940-aa15-44d8-a3fa-290055ccae23 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:03.610182 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a6940-aa15-44d8-a3fa-290055ccae23 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:03.610276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a6940-aa15-44d8-a3fa-290055ccae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:03.628576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-827a6940-aa15-44d8-a3fa-290055ccae23 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:31:03.629791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-827a6940-aa15-44d8-a3fa-290055ccae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:31:03.658439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:03.694554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 631/1294] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:31:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:31:03.964782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50a16-7fcd-410c-8fa0-e4a3dcab531d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:31:03.996750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:04.066962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50a16-7fcd-410c-8fa0-e4a3dcab531d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:31:04.102126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0760a-c8ec-44f4-9839-f0cca4534f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:31:04.102729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0760a-c8ec-44f4-9839-f0cca4534f47 None admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:04.103008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0760a-c8ec-44f4-9839-f0cca4534f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:04.103316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0760a-c8ec-44f4-9839-f0cca4534f47 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:04.103979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0760a-c8ec-44f4-9839-f0cca4534f47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:31:04.105381 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0760a-c8ec-44f4-9839-f0cca4534f47 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:31:04.288590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 664/1295] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 03:31:03 2022] POST /identity/v3/services => generated 246 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:31:06.210806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40cead-7857-4bc5-8f8e-768c6a4b262b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:06.211385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40cead-7857-4bc5-8f8e-768c6a4b262b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:06.211385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40cead-7857-4bc5-8f8e-768c6a4b262b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:06.215860 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 632/1296] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:31:06.218099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af72cb-2188-4088-91f9-1e7b12dc7259 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:06.218547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af72cb-2188-4088-91f9-1e7b12dc7259 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:06.218641 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af72cb-2188-4088-91f9-1e7b12dc7259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:06.237374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f4af72cb-2188-4088-91f9-1e7b12dc7259 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:31:06.238572 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f4af72cb-2188-4088-91f9-1e7b12dc7259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:31:06.312779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 665/1297] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:31:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:31:06.583592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40cead-7857-4bc5-8f8e-768c6a4b262b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:31:06.690676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40cead-7857-4bc5-8f8e-768c6a4b262b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:31:06.725260 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361eedd-32ea-4895-8b70-3278254da1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:31:06.725879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361eedd-32ea-4895-8b70-3278254da1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:06.726154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361eedd-32ea-4895-8b70-3278254da1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:06.726453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361eedd-32ea-4895-8b70-3278254da1a1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:06.727033 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361eedd-32ea-4895-8b70-3278254da1a1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:31:06.728418 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361eedd-32ea-4895-8b70-3278254da1a1 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-c361eedd-32ea-4895-8b70-3278254da1a1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:31:06.736952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:31:06.738110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:31:06.738981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 633/1298] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 03:31:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:31:06.744121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af72cb-2188-4088-91f9-1e7b12dc7259 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:31:06.762787 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:06.842834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af72cb-2188-4088-91f9-1e7b12dc7259 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:31:06.877926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e4a0b-4f0b-4e33-b2c0-6cf1b123d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:31:06.878545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4a0b-4f0b-4e33-b2c0-6cf1b123d360 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:06.878831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4a0b-4f0b-4e33-b2c0-6cf1b123d360 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:06.879136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e4a0b-4f0b-4e33-b2c0-6cf1b123d360 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:06.879779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e4a0b-4f0b-4e33-b2c0-6cf1b123d360 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:31:06.880086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e4a0b-4f0b-4e33-b2c0-6cf1b123d360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:31:06.881522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e4a0b-4f0b-4e33-b2c0-6cf1b123d360 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:31:06.887295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 666/1299] 10.222.0.88 () {56 vars in 1116 bytes} [Wed Aug 24 03:31:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:31:06.893307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361eedd-32ea-4895-8b70-3278254da1a1 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:31:06.924957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:06.991594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361eedd-32ea-4895-8b70-3278254da1a1 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:31:07.025903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380eac7d-4efa-4325-8e2d-91e8a3c697fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:31:07.026509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eac7d-4efa-4325-8e2d-91e8a3c697fe None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:07.026794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eac7d-4efa-4325-8e2d-91e8a3c697fe None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:07.027106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eac7d-4efa-4325-8e2d-91e8a3c697fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:07.027808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380eac7d-4efa-4325-8e2d-91e8a3c697fe None admin] RBAC: Adding query filter params (interface=public, service_id=1e6f0daf9de84c59800c9a2bb5a7a72f, region_id=RegionOne) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:31:07.028116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380eac7d-4efa-4325-8e2d-91e8a3c697fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:31:07.029520 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380eac7d-4efa-4325-8e2d-91e8a3c697fe None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:31:07.035643 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 634/1300] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 03:31:06 2022] GET /identity/v3/endpoints?service_id=1e6f0daf9de84c59800c9a2bb5a7a72f&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:31:07.041426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e4a0b-4f0b-4e33-b2c0-6cf1b123d360 None admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:31:07.123846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:07.141909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e4a0b-4f0b-4e33-b2c0-6cf1b123d360 None admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:31:07.174551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e497e41-8e46-4441-a8ce-867b3d231ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:31:07.175182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497e41-8e46-4441-a8ce-867b3d231ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:07.175465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497e41-8e46-4441-a8ce-867b3d231ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:07.175736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497e41-8e46-4441-a8ce-867b3d231ff0 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:07.176336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e497e41-8e46-4441-a8ce-867b3d231ff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:31:07.177719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e497e41-8e46-4441-a8ce-867b3d231ff0 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:31:07.184810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 667/1301] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 03:31:07 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:31:09.075246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5b77c-3955-4c8c-8c3a-7be597394b59 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:09.075947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5b77c-3955-4c8c-8c3a-7be597394b59 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:09.075947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5b77c-3955-4c8c-8c3a-7be597394b59 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:09.077152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 635/1302] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:31:09.082451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c84e5a-696c-4dfc-b519-446aed5b7666 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:09.082879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c84e5a-696c-4dfc-b519-446aed5b7666 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:09.082986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c84e5a-696c-4dfc-b519-446aed5b7666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:09.103018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f5c84e5a-696c-4dfc-b519-446aed5b7666 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:31:09.104259 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f5c84e5a-696c-4dfc-b519-446aed5b7666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:31:09.170953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 668/1303] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:31:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:31:09.448836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5b77c-3955-4c8c-8c3a-7be597394b59 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:31:09.542727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:09.549300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5b77c-3955-4c8c-8c3a-7be597394b59 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:31:09.583172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fcc48-db21-4a8d-af22-f0ed89f8b8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:31:09.583801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fcc48-db21-4a8d-af22-f0ed89f8b8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:09.584082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fcc48-db21-4a8d-af22-f0ed89f8b8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:09.584357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fcc48-db21-4a8d-af22-f0ed89f8b8e4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:09.584940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fcc48-db21-4a8d-af22-f0ed89f8b8e4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:31:09.586312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fcc48-db21-4a8d-af22-f0ed89f8b8e4 None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application [None req-010fcc48-db21-4a8d-af22-f0ed89f8b8e4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:31:09.594953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:31:09.596797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application with Lock( Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: ERROR keystone.server.flask.application Aug 24 03:31:09.597950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 636/1304] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 03:31:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:31:09.602503 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c84e5a-696c-4dfc-b519-446aed5b7666 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:31:09.678548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:09.701172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c84e5a-696c-4dfc-b519-446aed5b7666 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:31:09.734121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fa1e9-c5a8-4041-9112-85daccc46565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:31:09.734735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fa1e9-c5a8-4041-9112-85daccc46565 None admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:09.735022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fa1e9-c5a8-4041-9112-85daccc46565 None admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:09.735323 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fa1e9-c5a8-4041-9112-85daccc46565 None admin] PATH_INFO: `/v3/services` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:09.735956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fa1e9-c5a8-4041-9112-85daccc46565 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:31:09.736260 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fa1e9-c5a8-4041-9112-85daccc46565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:31:09.737646 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fa1e9-c5a8-4041-9112-85daccc46565 None admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:31:09.742618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 669/1305] 10.222.0.88 () {56 vars in 1116 bytes} [Wed Aug 24 03:31:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:31:09.749068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fcc48-db21-4a8d-af22-f0ed89f8b8e4 None admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:31:09.849753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fcc48-db21-4a8d-af22-f0ed89f8b8e4 None admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:31:09.884371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dd38d-5f60-4f16-8704-39eed865e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:31:09.884981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dd38d-5f60-4f16-8704-39eed865e98c None admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:31:09.885265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dd38d-5f60-4f16-8704-39eed865e98c None admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:31:09.885539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dd38d-5f60-4f16-8704-39eed865e98c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:31:09.886191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dd38d-5f60-4f16-8704-39eed865e98c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:31:09.887696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dd38d-5f60-4f16-8704-39eed865e98c None admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:31:10.003297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 637/1306] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:31:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:31:19.751004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=30 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:19.998647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:43.259815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05645cf8-4f15-4a5c-b814-adfba470a4ef None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:43.260405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05645cf8-4f15-4a5c-b814-adfba470a4ef None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:43.260405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05645cf8-4f15-4a5c-b814-adfba470a4ef None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:43.267766 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c26b6-3958-4b87-83f6-98ba9fead643 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:43.270498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c26b6-3958-4b87-83f6-98ba9fead643 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:43.270498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c26b6-3958-4b87-83f6-98ba9fead643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:43.270670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 670/1307] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:39:43 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:43.360192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-869c26b6-3958-4b87-83f6-98ba9fead643 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:43.361966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-869c26b6-3958-4b87-83f6-98ba9fead643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:43.487466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 638/1308] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:39:43.781025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c09d85-11bc-42bb-87b2-ea3d479ccfef None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:43.781958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c09d85-11bc-42bb-87b2-ea3d479ccfef None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:43.782484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c09d85-11bc-42bb-87b2-ea3d479ccfef None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:43.784686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 671/1309] 10.222.0.88 () {54 vars in 965 bytes} [Wed Aug 24 03:39:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:43.791581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ac69d-2925-4917-a4fb-3e97c98b7eaa None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:43.792044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ac69d-2925-4917-a4fb-3e97c98b7eaa None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:43.792334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ac69d-2925-4917-a4fb-3e97c98b7eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:43.881699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3b0ac69d-2925-4917-a4fb-3e97c98b7eaa None None] MFA Rules not processed for user `b4ab7a3b191e4a0b84b396cafa8a9ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:43.883021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3b0ac69d-2925-4917-a4fb-3e97c98b7eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:43.905055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:43.969921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 639/1310] 10.222.0.88 () {58 vars in 1062 bytes} [Wed Aug 24 03:39:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:43.979232 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c09d85-11bc-42bb-87b2-ea3d479ccfef None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:43.981258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c6c09d85-11bc-42bb-87b2-ea3d479ccfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:44.096226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c09d85-11bc-42bb-87b2-ea3d479ccfef None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:44.184549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014a33-9c9d-4566-9687-f3af265b6d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:44.185173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014a33-9c9d-4566-9687-f3af265b6d74 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:44.185459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014a33-9c9d-4566-9687-f3af265b6d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:44.185738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014a33-9c9d-4566-9687-f3af265b6d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:44.187448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f1014a33-9c9d-4566-9687-f3af265b6d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:44.252300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:44.314852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1014a33-9c9d-4566-9687-f3af265b6d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:44.324507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1014a33-9c9d-4566-9687-f3af265b6d74 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:44.344830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 672/1311] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:46.555244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f5963-cb19-4ca0-92f5-b7453efb681c None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:46.555813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f5963-cb19-4ca0-92f5-b7453efb681c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:46.556083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f5963-cb19-4ca0-92f5-b7453efb681c None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:46.558142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 640/1312] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:46.563762 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3be641-f7e3-4bd4-9db4-10f7c12b8ba1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:46.564651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3be641-f7e3-4bd4-9db4-10f7c12b8ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:46.565085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3be641-f7e3-4bd4-9db4-10f7c12b8ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:46.655638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8e3be641-f7e3-4bd4-9db4-10f7c12b8ba1 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:46.656917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8e3be641-f7e3-4bd4-9db4-10f7c12b8ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:46.774921 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 673/1313] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:47.056866 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f5963-cb19-4ca0-92f5-b7453efb681c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:47.058529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e84f5963-cb19-4ca0-92f5-b7453efb681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:47.284625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f5963-cb19-4ca0-92f5-b7453efb681c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:47.358386 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:47.361514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eddb17-c66b-4bc6-b1fc-7d5d68641d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:47.362136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eddb17-c66b-4bc6-b1fc-7d5d68641d4d service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:47.362420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eddb17-c66b-4bc6-b1fc-7d5d68641d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:47.362696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eddb17-c66b-4bc6-b1fc-7d5d68641d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:47.364376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-94eddb17-c66b-4bc6-b1fc-7d5d68641d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:47.484795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eddb17-c66b-4bc6-b1fc-7d5d68641d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:47.486913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eddb17-c66b-4bc6-b1fc-7d5d68641d4d service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:47.505742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 641/1314] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:49.936158 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552b215-fac6-409a-857e-c63d4ab958b1 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:49.936681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552b215-fac6-409a-857e-c63d4ab958b1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:49.936775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552b215-fac6-409a-857e-c63d4ab958b1 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:49.938079 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 674/1315] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:49.943347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20c9fa-e39a-4473-901a-6b0a54bfa211 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:49.943768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20c9fa-e39a-4473-901a-6b0a54bfa211 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:49.943900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20c9fa-e39a-4473-901a-6b0a54bfa211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:50.010562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-de20c9fa-e39a-4473-901a-6b0a54bfa211 None None] MFA Rules not processed for user `e4f302dc9d704ac4bcbb8f3332a3c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:50.011849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-de20c9fa-e39a-4473-901a-6b0a54bfa211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:50.064158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:50.106759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 642/1316] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:50.392327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552b215-fac6-409a-857e-c63d4ab958b1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:50.393910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1552b215-fac6-409a-857e-c63d4ab958b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:50.403660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:50.505737 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552b215-fac6-409a-857e-c63d4ab958b1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:50.580835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d004a0-ff46-4cf8-8314-9e53542e59d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:50.581437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d004a0-ff46-4cf8-8314-9e53542e59d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:50.581714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d004a0-ff46-4cf8-8314-9e53542e59d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:50.581986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d004a0-ff46-4cf8-8314-9e53542e59d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:50.583621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-29d004a0-ff46-4cf8-8314-9e53542e59d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:50.645130 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:50.696671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d004a0-ff46-4cf8-8314-9e53542e59d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:50.698156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d004a0-ff46-4cf8-8314-9e53542e59d1 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:50.719526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 675/1317] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:53.539560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f539-b859-47c4-9406-79caf0718ce7 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:53.540123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f539-b859-47c4-9406-79caf0718ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:53.540123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f539-b859-47c4-9406-79caf0718ce7 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:53.541459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 643/1318] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:53.546554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eadebf-50ab-4e0a-867a-50ba09da2bf6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:53.546961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eadebf-50ab-4e0a-867a-50ba09da2bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:53.547163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eadebf-50ab-4e0a-867a-50ba09da2bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:53.614052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-74eadebf-50ab-4e0a-867a-50ba09da2bf6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:53.615310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-74eadebf-50ab-4e0a-867a-50ba09da2bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:53.710991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 676/1319] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:54.012360 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f539-b859-47c4-9406-79caf0718ce7 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:54.013911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f3c2f539-b859-47c4-9406-79caf0718ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:54.117650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f539-b859-47c4-9406-79caf0718ce7 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:54.190554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59737b0-956b-41e1-9dc9-f2d6d62c0f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:54.191197 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59737b0-956b-41e1-9dc9-f2d6d62c0f66 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:54.191481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59737b0-956b-41e1-9dc9-f2d6d62c0f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:54.191754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59737b0-956b-41e1-9dc9-f2d6d62c0f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:54.193375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c59737b0-956b-41e1-9dc9-f2d6d62c0f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:54.200868 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:54.302347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59737b0-956b-41e1-9dc9-f2d6d62c0f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:54.303820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59737b0-956b-41e1-9dc9-f2d6d62c0f66 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:54.322173 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 644/1320] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:57.386283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea77d8-0407-44e6-9166-2462ff2878d1 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:57.386881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea77d8-0407-44e6-9166-2462ff2878d1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:57.386881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea77d8-0407-44e6-9166-2462ff2878d1 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:57.388241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 677/1321] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:57.394184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd8af2-ccba-4e01-8e1e-56744e8e7752 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:57.394634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd8af2-ccba-4e01-8e1e-56744e8e7752 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:57.394855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd8af2-ccba-4e01-8e1e-56744e8e7752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:57.466303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-cbbd8af2-ccba-4e01-8e1e-56744e8e7752 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:57.467563 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cbbd8af2-ccba-4e01-8e1e-56744e8e7752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:57.525870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:57.566932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 645/1322] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:57.860827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea77d8-0407-44e6-9166-2462ff2878d1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:57.862474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f5ea77d8-0407-44e6-9166-2462ff2878d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:57.882697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:57.967437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea77d8-0407-44e6-9166-2462ff2878d1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:58.039993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc6014-69a0-4ebf-a800-fea4fb83e48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:58.040524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc6014-69a0-4ebf-a800-fea4fb83e48d service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:58.040804 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc6014-69a0-4ebf-a800-fea4fb83e48d service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:58.041077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc6014-69a0-4ebf-a800-fea4fb83e48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:58.042686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-59cc6014-69a0-4ebf-a800-fea4fb83e48d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:58.132857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:58.171328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc6014-69a0-4ebf-a800-fea4fb83e48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:58.173356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc6014-69a0-4ebf-a800-fea4fb83e48d service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:58.191534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 678/1323] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:00.182236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634b986-022b-440e-ae54-eaa0fa16b172 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:00.182753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634b986-022b-440e-ae54-eaa0fa16b172 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:00.182753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634b986-022b-440e-ae54-eaa0fa16b172 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:00.184163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 646/1324] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:00.190160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd30b07-f027-45d9-96fa-c2407266e9f2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:00.190589 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd30b07-f027-45d9-96fa-c2407266e9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:00.190721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd30b07-f027-45d9-96fa-c2407266e9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:00.257590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0dd30b07-f027-45d9-96fa-c2407266e9f2 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:00.258824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0dd30b07-f027-45d9-96fa-c2407266e9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:00.355924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 679/1325] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:00.641978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634b986-022b-440e-ae54-eaa0fa16b172 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:00.643888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4634b986-022b-440e-ae54-eaa0fa16b172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:00.757590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634b986-022b-440e-ae54-eaa0fa16b172 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:00.831946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a32fd1-2e3a-4e9a-a6e7-8575c850f847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:00.832552 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a32fd1-2e3a-4e9a-a6e7-8575c850f847 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:00.832827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a32fd1-2e3a-4e9a-a6e7-8575c850f847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:00.833124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a32fd1-2e3a-4e9a-a6e7-8575c850f847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:00.834714 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-54a32fd1-2e3a-4e9a-a6e7-8575c850f847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:00.852836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:00.950148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a32fd1-2e3a-4e9a-a6e7-8575c850f847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:00.951676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a32fd1-2e3a-4e9a-a6e7-8575c850f847 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:00.971243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 647/1326] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:02.949246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4822764-46c9-457a-900e-22d09efc76bf None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:02.949832 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4822764-46c9-457a-900e-22d09efc76bf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:02.949832 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4822764-46c9-457a-900e-22d09efc76bf None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:02.951377 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 680/1327] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:02.957480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16873e3-f32d-4652-b59d-d1f481be8cce None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:02.957906 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16873e3-f32d-4652-b59d-d1f481be8cce None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:02.958140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16873e3-f32d-4652-b59d-d1f481be8cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:03.023919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b16873e3-f32d-4652-b59d-d1f481be8cce None None] MFA Rules not processed for user `e4f302dc9d704ac4bcbb8f3332a3c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:03.025032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b16873e3-f32d-4652-b59d-d1f481be8cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:03.099776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:03.136462 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 648/1328] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:03.447665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb012d-1734-4a85-8183-fb5fccc5aedd None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:03.447952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb012d-1734-4a85-8183-fb5fccc5aedd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:03.448229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb012d-1734-4a85-8183-fb5fccc5aedd None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:03.449662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 681/1329] 10.222.0.88 () {54 vars in 965 bytes} [Wed Aug 24 03:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:03.455772 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35610-12f4-4bb4-b5c5-6da85dfba388 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:03.456061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35610-12f4-4bb4-b5c5-6da85dfba388 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:03.456383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35610-12f4-4bb4-b5c5-6da85dfba388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:03.541812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-cdf35610-12f4-4bb4-b5c5-6da85dfba388 None None] MFA Rules not processed for user `b4ab7a3b191e4a0b84b396cafa8a9ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:03.543073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cdf35610-12f4-4bb4-b5c5-6da85dfba388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:03.656760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 649/1330] 10.222.0.88 () {58 vars in 1062 bytes} [Wed Aug 24 03:40:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:03.666124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb012d-1734-4a85-8183-fb5fccc5aedd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:03.667714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-09fb012d-1734-4a85-8183-fb5fccc5aedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:03.704733 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:03.801430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb012d-1734-4a85-8183-fb5fccc5aedd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:03.877789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3181c-0121-4dc4-8373-ddbe3087bab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:03.878397 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3181c-0121-4dc4-8373-ddbe3087bab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:03.878677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3181c-0121-4dc4-8373-ddbe3087bab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:03.878973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3181c-0121-4dc4-8373-ddbe3087bab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:03.880606 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c2d3181c-0121-4dc4-8373-ddbe3087bab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:03.968097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:04.003972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3181c-0121-4dc4-8373-ddbe3087bab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:04.005438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3181c-0121-4dc4-8373-ddbe3087bab0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:04.025173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 682/1331] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:40:06.805713 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32708b-7de8-4c60-b2b0-0b9428026f4d None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:06.806362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32708b-7de8-4c60-b2b0-0b9428026f4d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:06.806362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32708b-7de8-4c60-b2b0-0b9428026f4d None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:06.807702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 650/1332] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:06.815934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d20d-1d9a-4403-8704-c11db3ef589f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:06.816425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d20d-1d9a-4403-8704-c11db3ef589f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:06.816524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d20d-1d9a-4403-8704-c11db3ef589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:06.887490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-abb1d20d-1d9a-4403-8704-c11db3ef589f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:06.888727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-abb1d20d-1d9a-4403-8704-c11db3ef589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:07.007217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 683/1333] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:07.288259 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32708b-7de8-4c60-b2b0-0b9428026f4d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:07.289804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6b32708b-7de8-4c60-b2b0-0b9428026f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:07.359014 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:07.391958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32708b-7de8-4c60-b2b0-0b9428026f4d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:07.472558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a582c38-7569-41db-a4ad-8842dd040609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:07.473157 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a582c38-7569-41db-a4ad-8842dd040609 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:07.473433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a582c38-7569-41db-a4ad-8842dd040609 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:07.473704 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a582c38-7569-41db-a4ad-8842dd040609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:07.475338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2a582c38-7569-41db-a4ad-8842dd040609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:07.582860 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a582c38-7569-41db-a4ad-8842dd040609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:07.584330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a582c38-7569-41db-a4ad-8842dd040609 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:07.594224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:07.602887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 651/1334] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:09.561730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dbbd3-5d2f-4ba6-a98c-f63504e79986 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:09.562329 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dbbd3-5d2f-4ba6-a98c-f63504e79986 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:09.562329 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dbbd3-5d2f-4ba6-a98c-f63504e79986 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:09.563709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 684/1335] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:09.568863 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98f053-f5b5-4c4e-ba36-155c0271b20c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:09.569302 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98f053-f5b5-4c4e-ba36-155c0271b20c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:09.569401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98f053-f5b5-4c4e-ba36-155c0271b20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:09.634887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8c98f053-f5b5-4c4e-ba36-155c0271b20c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:09.636143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8c98f053-f5b5-4c4e-ba36-155c0271b20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:09.746156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 652/1336] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:10.036464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dbbd3-5d2f-4ba6-a98c-f63504e79986 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:10.038000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-812dbbd3-5d2f-4ba6-a98c-f63504e79986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:10.078172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:10.142633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dbbd3-5d2f-4ba6-a98c-f63504e79986 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:10.215914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababda33-bc99-4ca6-87b3-c8acb72ddbb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:10.218790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababda33-bc99-4ca6-87b3-c8acb72ddbb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:10.218790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababda33-bc99-4ca6-87b3-c8acb72ddbb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:10.218790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababda33-bc99-4ca6-87b3-c8acb72ddbb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:10.218790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ababda33-bc99-4ca6-87b3-c8acb72ddbb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:10.304527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:10.331195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababda33-bc99-4ca6-87b3-c8acb72ddbb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:10.332692 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababda33-bc99-4ca6-87b3-c8acb72ddbb0 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:10.352432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 685/1337] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:13.025708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a2605-acd0-4d3e-bdf2-dcd833d3eb55 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:13.026268 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a2605-acd0-4d3e-bdf2-dcd833d3eb55 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:13.026268 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a2605-acd0-4d3e-bdf2-dcd833d3eb55 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:13.027655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 653/1338] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:13.033354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69108396-0405-44cc-b8c2-6eb42f81f60f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:13.033764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69108396-0405-44cc-b8c2-6eb42f81f60f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:13.033903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69108396-0405-44cc-b8c2-6eb42f81f60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:13.100301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-69108396-0405-44cc-b8c2-6eb42f81f60f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:13.101516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-69108396-0405-44cc-b8c2-6eb42f81f60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:13.196169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 686/1339] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:40:13.483541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a2605-acd0-4d3e-bdf2-dcd833d3eb55 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:13.485124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-692a2605-acd0-4d3e-bdf2-dcd833d3eb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:13.564641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:13.591496 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a2605-acd0-4d3e-bdf2-dcd833d3eb55 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:13.676521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c4131-1012-4b0e-99b0-37a1bd293e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:13.677124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c4131-1012-4b0e-99b0-37a1bd293e6f service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:13.677399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c4131-1012-4b0e-99b0-37a1bd293e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:13.677673 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c4131-1012-4b0e-99b0-37a1bd293e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:13.679300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1c6c4131-1012-4b0e-99b0-37a1bd293e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:13.786940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c4131-1012-4b0e-99b0-37a1bd293e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:13.788405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c4131-1012-4b0e-99b0-37a1bd293e6f service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:13.807104 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 654/1340] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:18.021110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709994b-6f75-4d19-8005-c79a139f3e5e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:18.021652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709994b-6f75-4d19-8005-c79a139f3e5e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:18.021652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709994b-6f75-4d19-8005-c79a139f3e5e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:18.023104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 687/1341] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:18.028406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc1e85-91fc-4fc1-a172-e3a42c46562a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:18.028877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc1e85-91fc-4fc1-a172-e3a42c46562a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:18.028982 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc1e85-91fc-4fc1-a172-e3a42c46562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:18.034413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:18.099400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bfdc1e85-91fc-4fc1-a172-e3a42c46562a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:18.100715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bfdc1e85-91fc-4fc1-a172-e3a42c46562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:18.201026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 655/1342] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:18.497635 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709994b-6f75-4d19-8005-c79a139f3e5e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:18.499227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c709994b-6f75-4d19-8005-c79a139f3e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:18.549555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:18.604767 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709994b-6f75-4d19-8005-c79a139f3e5e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:18.684776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c1658-b03a-4d0d-87e7-f0724fa35ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:18.685393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c1658-b03a-4d0d-87e7-f0724fa35ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:18.685718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c1658-b03a-4d0d-87e7-f0724fa35ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:18.685984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c1658-b03a-4d0d-87e7-f0724fa35ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:18.687690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-919c1658-b03a-4d0d-87e7-f0724fa35ba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:18.789619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:18.806194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c1658-b03a-4d0d-87e7-f0724fa35ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:18.807690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c1658-b03a-4d0d-87e7-f0724fa35ba7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:18.826609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 688/1343] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:21.818706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d4f3d-48ea-492b-b073-be2901298900 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:21.819245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d4f3d-48ea-492b-b073-be2901298900 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:21.819245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d4f3d-48ea-492b-b073-be2901298900 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:21.820577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 656/1344] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:21.825739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5f23-9f47-4bc5-a6cd-bf5310d4335b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:21.826140 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5f23-9f47-4bc5-a6cd-bf5310d4335b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:21.826301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5f23-9f47-4bc5-a6cd-bf5310d4335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:21.924101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-84ce5f23-9f47-4bc5-a6cd-bf5310d4335b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:21.925342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-84ce5f23-9f47-4bc5-a6cd-bf5310d4335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:22.021857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 689/1345] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:22.310893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d4f3d-48ea-492b-b073-be2901298900 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:22.312489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9b4d4f3d-48ea-492b-b073-be2901298900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:22.405423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:22.424135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d4f3d-48ea-492b-b073-be2901298900 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:22.503793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfa61c-21b9-44b6-8170-92500b50a0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:22.504405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa61c-21b9-44b6-8170-92500b50a0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:22.504687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa61c-21b9-44b6-8170-92500b50a0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:22.504961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa61c-21b9-44b6-8170-92500b50a0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:22.506572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e8dfa61c-21b9-44b6-8170-92500b50a0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:22.623409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfa61c-21b9-44b6-8170-92500b50a0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:22.624850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfa61c-21b9-44b6-8170-92500b50a0e5 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:22.644417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 657/1346] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:26.835202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241407-f29e-44ae-b2f1-a610aa01120a None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:26.835679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241407-f29e-44ae-b2f1-a610aa01120a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:26.835791 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241407-f29e-44ae-b2f1-a610aa01120a None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:26.837126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 690/1347] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:26.843246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3977fa-2724-4da5-abc4-24e5bca84d40 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:26.844267 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3977fa-2724-4da5-abc4-24e5bca84d40 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:26.844378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3977fa-2724-4da5-abc4-24e5bca84d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:26.861011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:26.919566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1b3977fa-2724-4da5-abc4-24e5bca84d40 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:26.920757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1b3977fa-2724-4da5-abc4-24e5bca84d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:27.041968 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 658/1348] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:27.327360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241407-f29e-44ae-b2f1-a610aa01120a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:27.328273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-43241407-f29e-44ae-b2f1-a610aa01120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:27.388845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:27.435284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241407-f29e-44ae-b2f1-a610aa01120a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:27.508392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83ffb2-9512-41d1-be5c-c14928ebb52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:27.509000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ffb2-9512-41d1-be5c-c14928ebb52e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:27.509303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ffb2-9512-41d1-be5c-c14928ebb52e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:27.509556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ffb2-9512-41d1-be5c-c14928ebb52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:27.511215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ef83ffb2-9512-41d1-be5c-c14928ebb52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:27.617780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:27.621284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83ffb2-9512-41d1-be5c-c14928ebb52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:27.622721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83ffb2-9512-41d1-be5c-c14928ebb52e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:27.640270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 691/1349] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:32.697154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caaf62-961e-4239-81ad-8f0dac89b15f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:32.707163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caaf62-961e-4239-81ad-8f0dac89b15f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:32.707163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6caaf62-961e-4239-81ad-8f0dac89b15f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:32.707163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 659/1350] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:32.707525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b95e-fcb0-4c04-bf7c-62e03740c280 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:32.707525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b95e-fcb0-4c04-bf7c-62e03740c280 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:32.707525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b95e-fcb0-4c04-bf7c-62e03740c280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:32.797293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0f47b95e-fcb0-4c04-bf7c-62e03740c280 None None] MFA Rules not processed for user `e686e974721345eba4de46cde2edaf34`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:32.798976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0f47b95e-fcb0-4c04-bf7c-62e03740c280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:32.964291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 692/1351] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:40:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:37.040035 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=59 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:37.379758 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256d505-4344-4491-a6c8-e2c6e5c0f06d None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:37.380194 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256d505-4344-4491-a6c8-e2c6e5c0f06d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:37.380340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256d505-4344-4491-a6c8-e2c6e5c0f06d None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:37.381979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 660/1352] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:37.391533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82033fd1-5c04-4a78-b106-0419bb54b6a2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:37.392520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82033fd1-5c04-4a78-b106-0419bb54b6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:37.393112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82033fd1-5c04-4a78-b106-0419bb54b6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:37.459638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:37.486961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-82033fd1-5c04-4a78-b106-0419bb54b6a2 None None] MFA Rules not processed for user `e686e974721345eba4de46cde2edaf34`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:37.488201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-82033fd1-5c04-4a78-b106-0419bb54b6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:37.615539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 693/1353] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:40:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:38.700735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167df317-c519-46f7-af24-d79313e5fe53 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:38.701240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167df317-c519-46f7-af24-d79313e5fe53 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:38.701240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167df317-c519-46f7-af24-d79313e5fe53 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:38.702746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 661/1354] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:38.707802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569996f-77d3-4072-a4de-16117d3c2295 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:38.708226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569996f-77d3-4072-a4de-16117d3c2295 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:38.708504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569996f-77d3-4072-a4de-16117d3c2295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:38.795555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4569996f-77d3-4072-a4de-16117d3c2295 None None] MFA Rules not processed for user `e686e974721345eba4de46cde2edaf34`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:38.797492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4569996f-77d3-4072-a4de-16117d3c2295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:38.844477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:38.912447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 694/1355] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:40:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:42.240953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c23f8-837a-4c0f-b553-5547e576892d None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:42.247575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c23f8-837a-4c0f-b553-5547e576892d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:42.247575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c23f8-837a-4c0f-b553-5547e576892d None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:42.247575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 662/1356] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:42.248527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453477fa-5bf9-4f71-b085-fe03af8e055f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:42.249902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453477fa-5bf9-4f71-b085-fe03af8e055f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:42.250462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453477fa-5bf9-4f71-b085-fe03af8e055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:42.335709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-453477fa-5bf9-4f71-b085-fe03af8e055f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:42.337035 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-453477fa-5bf9-4f71-b085-fe03af8e055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:42.472356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 695/1357] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:42.786946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc222-5b6e-42c1-8384-77a574effaad None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:42.796085 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc222-5b6e-42c1-8384-77a574effaad None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:42.796085 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc222-5b6e-42c1-8384-77a574effaad None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:42.796085 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 663/1358] 10.222.0.88 () {54 vars in 962 bytes} [Wed Aug 24 03:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:42.796396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c675c-fd7a-45a4-940d-309c024b5100 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:42.796396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c675c-fd7a-45a4-940d-309c024b5100 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:42.796396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c675c-fd7a-45a4-940d-309c024b5100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:42.813550 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:42.880922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e03c675c-fd7a-45a4-940d-309c024b5100 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:42.882135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e03c675c-fd7a-45a4-940d-309c024b5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:43.008685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 696/1359] 10.222.0.88 () {58 vars in 1059 bytes} [Wed Aug 24 03:40:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:43.016810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc222-5b6e-42c1-8384-77a574effaad None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:43.018389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1dffc222-5b6e-42c1-8384-77a574effaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:43.179951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc222-5b6e-42c1-8384-77a574effaad None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:43.260343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:43.307068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba602b-f42d-44de-b850-535e3f069bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:43.307605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba602b-f42d-44de-b850-535e3f069bc9 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:43.307885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba602b-f42d-44de-b850-535e3f069bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:43.308155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba602b-f42d-44de-b850-535e3f069bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:43.309794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-49ba602b-f42d-44de-b850-535e3f069bc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:43.407212 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba602b-f42d-44de-b850-535e3f069bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:43.408829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba602b-f42d-44de-b850-535e3f069bc9 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:43.427591 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 664/1360] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:45.623026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d987e-cb76-40f8-b884-df87ef90b4cf None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:45.623577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d987e-cb76-40f8-b884-df87ef90b4cf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:45.623680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d987e-cb76-40f8-b884-df87ef90b4cf None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:45.625036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 697/1361] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:45.630771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d06e-a9af-4d0d-8247-6433fad9a73e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:45.631330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d06e-a9af-4d0d-8247-6433fad9a73e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:45.631410 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d06e-a9af-4d0d-8247-6433fad9a73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:45.703154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-21b5d06e-a9af-4d0d-8247-6433fad9a73e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:45.704303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-21b5d06e-a9af-4d0d-8247-6433fad9a73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:45.747005 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:45.815313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 665/1362] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:46.110634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d987e-cb76-40f8-b884-df87ef90b4cf None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:46.110634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e62d987e-cb76-40f8-b884-df87ef90b4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:46.197068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:46.285755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d987e-cb76-40f8-b884-df87ef90b4cf None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:46.406857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa0803-2ae4-4729-a971-e3259aaacd34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:46.407505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa0803-2ae4-4729-a971-e3259aaacd34 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:46.407788 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa0803-2ae4-4729-a971-e3259aaacd34 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:46.408061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa0803-2ae4-4729-a971-e3259aaacd34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:46.409694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f2fa0803-2ae4-4729-a971-e3259aaacd34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:46.436754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:46.513824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa0803-2ae4-4729-a971-e3259aaacd34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:46.516031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa0803-2ae4-4729-a971-e3259aaacd34 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:46.536254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 698/1363] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:49.083291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188354d9-53d3-4208-bdcf-19aad4634799 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:49.084153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188354d9-53d3-4208-bdcf-19aad4634799 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:49.084443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188354d9-53d3-4208-bdcf-19aad4634799 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:49.085817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 666/1364] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:49.091289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a42fc3-1c8f-4c8e-b01e-3d0b6fccc58b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:49.091717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a42fc3-1c8f-4c8e-b01e-3d0b6fccc58b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:49.091825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a42fc3-1c8f-4c8e-b01e-3d0b6fccc58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:49.163404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-67a42fc3-1c8f-4c8e-b01e-3d0b6fccc58b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:49.164688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-67a42fc3-1c8f-4c8e-b01e-3d0b6fccc58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:49.272031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:49.279251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 699/1365] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:49.566832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8db3-0412-4be3-a04f-76a7c76d41fe None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:49.567149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8db3-0412-4be3-a04f-76a7c76d41fe None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:49.567427 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8db3-0412-4be3-a04f-76a7c76d41fe None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:49.568794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 667/1366] 10.222.0.88 () {54 vars in 962 bytes} [Wed Aug 24 03:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:49.574605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51a95c-f33b-4811-9d72-c70a39dd7799 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:49.574895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51a95c-f33b-4811-9d72-c70a39dd7799 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:49.575315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51a95c-f33b-4811-9d72-c70a39dd7799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:49.657707 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ca51a95c-f33b-4811-9d72-c70a39dd7799 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:49.658938 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ca51a95c-f33b-4811-9d72-c70a39dd7799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:49.786031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 700/1367] 10.222.0.88 () {58 vars in 1059 bytes} [Wed Aug 24 03:40:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:49.794075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8db3-0412-4be3-a04f-76a7c76d41fe None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:49.797387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-27ab8db3-0412-4be3-a04f-76a7c76d41fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:49.965708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8db3-0412-4be3-a04f-76a7c76d41fe None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:49.991314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:50.097474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19437f56-e045-4f3c-82ff-320d2ef3a853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:50.098154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437f56-e045-4f3c-82ff-320d2ef3a853 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:50.098402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437f56-e045-4f3c-82ff-320d2ef3a853 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:50.098619 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437f56-e045-4f3c-82ff-320d2ef3a853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:50.100258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-19437f56-e045-4f3c-82ff-320d2ef3a853 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:50.193620 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19437f56-e045-4f3c-82ff-320d2ef3a853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:50.195307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19437f56-e045-4f3c-82ff-320d2ef3a853 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:50.214671 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 668/1368] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:50.525778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27096ba1-ae6c-4271-9bcf-ebd05057e85b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:50.526309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27096ba1-ae6c-4271-9bcf-ebd05057e85b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:50.526309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27096ba1-ae6c-4271-9bcf-ebd05057e85b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:50.527728 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 701/1369] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:50.533216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cb4ef-60a6-462e-9c94-51c1d8b63530 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:50.533580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cb4ef-60a6-462e-9c94-51c1d8b63530 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:50.533927 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cb4ef-60a6-462e-9c94-51c1d8b63530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:50.568561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:50.611285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-398cb4ef-60a6-462e-9c94-51c1d8b63530 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:50.612564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-398cb4ef-60a6-462e-9c94-51c1d8b63530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:50.730252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 669/1370] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:51.352447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1a967-a9c0-4fe7-9903-cef538dca1ea None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:51.352734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1a967-a9c0-4fe7-9903-cef538dca1ea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:51.353012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1a967-a9c0-4fe7-9903-cef538dca1ea None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:51.354509 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 702/1371] 10.222.0.88 () {54 vars in 964 bytes} [Wed Aug 24 03:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:51.359533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174644c2-8e17-44ec-b2ab-4499a5d900c4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:51.359989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174644c2-8e17-44ec-b2ab-4499a5d900c4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:51.360081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174644c2-8e17-44ec-b2ab-4499a5d900c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:51.440918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-174644c2-8e17-44ec-b2ab-4499a5d900c4 None None] MFA Rules not processed for user `380240bcfca240a2b4969f6618409a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:51.442032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-174644c2-8e17-44ec-b2ab-4499a5d900c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:51.499662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:51.527993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 670/1372] 10.222.0.88 () {58 vars in 1061 bytes} [Wed Aug 24 03:40:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:40:51.536187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1a967-a9c0-4fe7-9903-cef538dca1ea None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:51.537712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bdd1a967-a9c0-4fe7-9903-cef538dca1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:51.595447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:51.653163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1a967-a9c0-4fe7-9903-cef538dca1ea None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:51.732862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e6b67-30d8-49da-b8fc-ea02d04a461a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:51.734040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e6b67-30d8-49da-b8fc-ea02d04a461a service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:51.734320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e6b67-30d8-49da-b8fc-ea02d04a461a service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:51.734591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e6b67-30d8-49da-b8fc-ea02d04a461a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:51.736328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b35e6b67-30d8-49da-b8fc-ea02d04a461a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:51.845432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:51.866821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e6b67-30d8-49da-b8fc-ea02d04a461a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:51.868687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e6b67-30d8-49da-b8fc-ea02d04a461a service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:51.898034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 703/1373] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:52.447110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ed511-27c1-4be7-9d8d-b132c39e2d0b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:52.447641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ed511-27c1-4be7-9d8d-b132c39e2d0b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:52.447737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ed511-27c1-4be7-9d8d-b132c39e2d0b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:52.449152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 671/1374] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:52.454559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d12f1-c76a-4c8a-b8c0-43e8f9af0e15 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:52.454844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d12f1-c76a-4c8a-b8c0-43e8f9af0e15 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:52.455162 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d12f1-c76a-4c8a-b8c0-43e8f9af0e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:52.525015 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b03d12f1-c76a-4c8a-b8c0-43e8f9af0e15 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:52.526248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b03d12f1-c76a-4c8a-b8c0-43e8f9af0e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:52.634344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 704/1375] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:52.927710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ed511-27c1-4be7-9d8d-b132c39e2d0b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:52.929271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8c7ed511-27c1-4be7-9d8d-b132c39e2d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:53.089299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ed511-27c1-4be7-9d8d-b132c39e2d0b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:53.141740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:53.202891 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75f35c-4a7c-4e49-9f14-2cb5d3c40b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:53.203533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f35c-4a7c-4e49-9f14-2cb5d3c40b69 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:53.203847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f35c-4a7c-4e49-9f14-2cb5d3c40b69 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:53.204122 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f35c-4a7c-4e49-9f14-2cb5d3c40b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:53.208843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7a75f35c-4a7c-4e49-9f14-2cb5d3c40b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:53.318291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75f35c-4a7c-4e49-9f14-2cb5d3c40b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:53.320838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75f35c-4a7c-4e49-9f14-2cb5d3c40b69 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:53.341544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 672/1376] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:55.490345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff679431-d204-4730-bed1-73776602bef6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:55.490857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff679431-d204-4730-bed1-73776602bef6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:55.491486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff679431-d204-4730-bed1-73776602bef6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:55.492318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 705/1377] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:55.498158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a83bb-fd4b-4d7b-85e1-a43503e7f3f5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:55.499199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a83bb-fd4b-4d7b-85e1-a43503e7f3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:55.499296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a83bb-fd4b-4d7b-85e1-a43503e7f3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:55.601563 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-490a83bb-fd4b-4d7b-85e1-a43503e7f3f5 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:55.603263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-490a83bb-fd4b-4d7b-85e1-a43503e7f3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:55.614328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:55.738101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 673/1378] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:56.026486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff679431-d204-4730-bed1-73776602bef6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:56.028215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ff679431-d204-4730-bed1-73776602bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:56.095693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:56.190343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff679431-d204-4730-bed1-73776602bef6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:56.319073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090dcc2-cd3b-4241-8a5a-4344ed9de3b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:56.320290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090dcc2-cd3b-4241-8a5a-4344ed9de3b6 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.320820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090dcc2-cd3b-4241-8a5a-4344ed9de3b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.321219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090dcc2-cd3b-4241-8a5a-4344ed9de3b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.322844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d090dcc2-cd3b-4241-8a5a-4344ed9de3b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:56.343506 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:56.436222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090dcc2-cd3b-4241-8a5a-4344ed9de3b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:56.437838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090dcc2-cd3b-4241-8a5a-4344ed9de3b6 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:56.457932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 706/1379] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:58.583032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301960f8-6be6-4e5f-bb85-61f0e1c7293f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:58.583593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301960f8-6be6-4e5f-bb85-61f0e1c7293f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:58.583593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301960f8-6be6-4e5f-bb85-61f0e1c7293f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:58.585135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 674/1380] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:58.590369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d570464-488b-46c5-8e47-21c180991146 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:58.590812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d570464-488b-46c5-8e47-21c180991146 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:58.590939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d570464-488b-46c5-8e47-21c180991146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:58.665499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2d570464-488b-46c5-8e47-21c180991146 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:58.666560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d570464-488b-46c5-8e47-21c180991146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:58.771522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:58.791159 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 707/1381] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:59.069362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301960f8-6be6-4e5f-bb85-61f0e1c7293f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:59.071013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-301960f8-6be6-4e5f-bb85-61f0e1c7293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:59.233838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301960f8-6be6-4e5f-bb85-61f0e1c7293f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:59.237017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:59.357933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede6b81-fa24-4796-97ca-7a6fe3dcc96a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:59.358542 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede6b81-fa24-4796-97ca-7a6fe3dcc96a service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:59.358817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede6b81-fa24-4796-97ca-7a6fe3dcc96a service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:59.359105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede6b81-fa24-4796-97ca-7a6fe3dcc96a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:59.361103 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-aede6b81-fa24-4796-97ca-7a6fe3dcc96a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:59.456876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede6b81-fa24-4796-97ca-7a6fe3dcc96a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:59.458519 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede6b81-fa24-4796-97ca-7a6fe3dcc96a service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:59.470579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:59.479039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 675/1382] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:01.649686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e54f-cb29-4eb4-8ac1-c52023db4aaa None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:01.649686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e54f-cb29-4eb4-8ac1-c52023db4aaa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:01.649686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e54f-cb29-4eb4-8ac1-c52023db4aaa None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:01.650810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 708/1383] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:01.656723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d07ecf-859c-418d-88cf-988caa561260 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:01.657166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d07ecf-859c-418d-88cf-988caa561260 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:01.657261 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d07ecf-859c-418d-88cf-988caa561260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:01.735680 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-45d07ecf-859c-418d-88cf-988caa561260 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:01.737467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-45d07ecf-859c-418d-88cf-988caa561260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:01.841905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 676/1384] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:02.141388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e54f-cb29-4eb4-8ac1-c52023db4aaa None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:02.143742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e6c3e54f-cb29-4eb4-8ac1-c52023db4aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:02.333845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e54f-cb29-4eb4-8ac1-c52023db4aaa None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:02.407936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:02.474843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8a300-0cc7-42fb-acb5-53c7af1d635c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:02.475512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8a300-0cc7-42fb-acb5-53c7af1d635c service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:02.475808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8a300-0cc7-42fb-acb5-53c7af1d635c service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:02.476095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8a300-0cc7-42fb-acb5-53c7af1d635c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:02.477792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b3f8a300-0cc7-42fb-acb5-53c7af1d635c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:02.579235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8a300-0cc7-42fb-acb5-53c7af1d635c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:02.581300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8a300-0cc7-42fb-acb5-53c7af1d635c service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:02.602920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 709/1385] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:04.568882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261234cc-6d3e-4aef-8082-c29393da4fcd None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:04.569452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261234cc-6d3e-4aef-8082-c29393da4fcd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:04.569452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261234cc-6d3e-4aef-8082-c29393da4fcd None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:04.570798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 677/1386] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:04.576541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cb181-d2a8-47de-86d6-0b1f83c7e6d4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:04.577063 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cb181-d2a8-47de-86d6-0b1f83c7e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:04.577160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cb181-d2a8-47de-86d6-0b1f83c7e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:04.658335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b21cb181-d2a8-47de-86d6-0b1f83c7e6d4 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:04.659572 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b21cb181-d2a8-47de-86d6-0b1f83c7e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:04.696703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:04.778338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 710/1387] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:05.076456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261234cc-6d3e-4aef-8082-c29393da4fcd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:05.078007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-261234cc-6d3e-4aef-8082-c29393da4fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:05.173049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:05.261986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261234cc-6d3e-4aef-8082-c29393da4fcd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:05.410625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8209ef7-adf8-4db5-af5b-c6d2b70b1985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:05.411267 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209ef7-adf8-4db5-af5b-c6d2b70b1985 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:05.411550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209ef7-adf8-4db5-af5b-c6d2b70b1985 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:05.411831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209ef7-adf8-4db5-af5b-c6d2b70b1985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:05.413627 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e8209ef7-adf8-4db5-af5b-c6d2b70b1985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:05.466565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:05.523517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8209ef7-adf8-4db5-af5b-c6d2b70b1985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:05.525055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8209ef7-adf8-4db5-af5b-c6d2b70b1985 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:05.544987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 678/1388] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:41:07.667151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1127e-d9cc-45ad-9445-00f47819b136 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:07.667806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1127e-d9cc-45ad-9445-00f47819b136 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:07.667806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1127e-d9cc-45ad-9445-00f47819b136 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:07.669326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 711/1389] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:07.675709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7ca3f-f69d-4b2f-a52a-78ccf3c1f0a4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:07.676192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7ca3f-f69d-4b2f-a52a-78ccf3c1f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:07.676291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7ca3f-f69d-4b2f-a52a-78ccf3c1f0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:07.749831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0bb7ca3f-f69d-4b2f-a52a-78ccf3c1f0a4 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:07.751168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0bb7ca3f-f69d-4b2f-a52a-78ccf3c1f0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:07.852996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 679/1390] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:08.020178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf09ed-1d71-4a1f-9012-9488349f6be0 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:08.020471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf09ed-1d71-4a1f-9012-9488349f6be0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:08.020755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf09ed-1d71-4a1f-9012-9488349f6be0 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:08.022131 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 712/1391] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:08.027517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3fcdc-035d-4873-95b6-b511f904c42a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:08.027809 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3fcdc-035d-4873-95b6-b511f904c42a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:08.028084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3fcdc-035d-4873-95b6-b511f904c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:08.043729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:08.094831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-deb3fcdc-035d-4873-95b6-b511f904c42a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:08.096347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-deb3fcdc-035d-4873-95b6-b511f904c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:08.141589 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf09ed-1d71-4a1f-9012-9488349f6be0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:08.143146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-33cf09ed-1d71-4a1f-9012-9488349f6be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:08.197389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 680/1392] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:08.302776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf09ed-1d71-4a1f-9012-9488349f6be0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:08.320087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:08.417030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22872347-83af-4a11-b16e-f7237a8119df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:08.417637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22872347-83af-4a11-b16e-f7237a8119df service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:08.417919 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22872347-83af-4a11-b16e-f7237a8119df service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:08.418194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22872347-83af-4a11-b16e-f7237a8119df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:08.419918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-22872347-83af-4a11-b16e-f7237a8119df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:08.500893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b8f14-848d-4381-aba3-0d13cc0bcda2 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:08.501177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b8f14-848d-4381-aba3-0d13cc0bcda2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:08.501443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b8f14-848d-4381-aba3-0d13cc0bcda2 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:08.502827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 681/1393] 10.222.0.88 () {54 vars in 967 bytes} [Wed Aug 24 03:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:41:08.507666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdf8b-794a-4f80-9713-b0db2a065a4e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:08.508068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdf8b-794a-4f80-9713-b0db2a065a4e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:08.508350 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdf8b-794a-4f80-9713-b0db2a065a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:08.511200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22872347-83af-4a11-b16e-f7237a8119df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:08.512986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22872347-83af-4a11-b16e-f7237a8119df service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:08.533065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 713/1394] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:41:08.587758 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-148cdf8b-794a-4f80-9713-b0db2a065a4e None None] MFA Rules not processed for user `6955fc5b81a040f686e21621ea968a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:08.588907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-148cdf8b-794a-4f80-9713-b0db2a065a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:08.624117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:08.667605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 682/1395] 10.222.0.88 () {58 vars in 1064 bytes} [Wed Aug 24 03:41:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:08.675786 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22872347-83af-4a11-b16e-f7237a8119df service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:08.677083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-22872347-83af-4a11-b16e-f7237a8119df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:08.699311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:08.755578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22872347-83af-4a11-b16e-f7237a8119df service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:08.839174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be609de-f550-4f5e-a889-d558beb81e31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6955fc5b81a040f686e21621ea968a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:08.840072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be609de-f550-4f5e-a889-d558beb81e31 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:08.840535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be609de-f550-4f5e-a889-d558beb81e31 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:08.840977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be609de-f550-4f5e-a889-d558beb81e31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:08.842884 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6be609de-f550-4f5e-a889-d558beb81e31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:08.962386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:08.975266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be609de-f550-4f5e-a889-d558beb81e31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:08.976827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be609de-f550-4f5e-a889-d558beb81e31 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:08.995646 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 714/1396] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:09.913440 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718669-cafc-412c-af88-030eda486a60 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:09.913982 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718669-cafc-412c-af88-030eda486a60 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:09.914241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718669-cafc-412c-af88-030eda486a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:09.980768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b1718669-cafc-412c-af88-030eda486a60 None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:09.981999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b1718669-cafc-412c-af88-030eda486a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:10.069661 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 683/1397] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:41:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:10.113486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff889f-c989-40c0-afb7-a484f6b10cdc None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:10.113995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff889f-c989-40c0-afb7-a484f6b10cdc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:10.114092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff889f-c989-40c0-afb7-a484f6b10cdc None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:10.115465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 715/1398] 10.222.0.88 () {54 vars in 943 bytes} [Wed Aug 24 03:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:10.121811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41741fcc-5e12-4fb4-8199-e898569de651 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:10.122105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41741fcc-5e12-4fb4-8199-e898569de651 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:10.122388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41741fcc-5e12-4fb4-8199-e898569de651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:10.183381 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:10.205086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-41741fcc-5e12-4fb4-8199-e898569de651 None None] MFA Rules not processed for user `d4052d31496a46948211cd4b7d38808b`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:10.206675 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-41741fcc-5e12-4fb4-8199-e898569de651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:10.331101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 684/1399] 10.222.0.88 () {58 vars in 1040 bytes} [Wed Aug 24 03:41:10 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:10.342238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff889f-c989-40c0-afb7-a484f6b10cdc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:10.343915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a8ff889f-c989-40c0-afb7-a484f6b10cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:10.483138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff889f-c989-40c0-afb7-a484f6b10cdc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:10.548177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:10.589305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4cda2-65d3-4b68-8778-d4c9a239b59c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:10.589933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4cda2-65d3-4b68-8778-d4c9a239b59c service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:10.590343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4cda2-65d3-4b68-8778-d4c9a239b59c service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:10.590618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4cda2-65d3-4b68-8778-d4c9a239b59c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:10.596981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-00b4cda2-65d3-4b68-8778-d4c9a239b59c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:10.622942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936d64a-47bb-448f-825e-15e382d5d827 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:10.623414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936d64a-47bb-448f-825e-15e382d5d827 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:10.623698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936d64a-47bb-448f-825e-15e382d5d827 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:10.625098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 685/1400] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:41:10.630052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82192524-bd70-46ed-9b9d-3fefd9dd63cd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:10.630338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82192524-bd70-46ed-9b9d-3fefd9dd63cd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:10.630610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82192524-bd70-46ed-9b9d-3fefd9dd63cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:10.687077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4cda2-65d3-4b68-8778-d4c9a239b59c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:10.688798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4cda2-65d3-4b68-8778-d4c9a239b59c service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:10.697378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 716/1401] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:41:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:41:10.698351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-82192524-bd70-46ed-9b9d-3fefd9dd63cd None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:10.699737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-82192524-bd70-46ed-9b9d-3fefd9dd63cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:10.768530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:10.813535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 686/1402] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:11.125850 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4cda2-65d3-4b68-8778-d4c9a239b59c service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:11.127096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-00b4cda2-65d3-4b68-8778-d4c9a239b59c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:11.226122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4cda2-65d3-4b68-8778-d4c9a239b59c service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:11.244086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:11.354229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090c55a-e1b0-47de-8a82-27774639da44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:11.355311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090c55a-e1b0-47de-8a82-27774639da44 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:11.356681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090c55a-e1b0-47de-8a82-27774639da44 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:11.356681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090c55a-e1b0-47de-8a82-27774639da44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:11.358060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3090c55a-e1b0-47de-8a82-27774639da44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:11.465205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090c55a-e1b0-47de-8a82-27774639da44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:11.467516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090c55a-e1b0-47de-8a82-27774639da44 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:11.486769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 717/1403] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:13.674066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de1c78-1a2e-455b-93ed-3b75bce2287b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:13.674683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de1c78-1a2e-455b-93ed-3b75bce2287b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:13.674683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de1c78-1a2e-455b-93ed-3b75bce2287b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:13.679400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 687/1404] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:41:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:13.681379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1a7f-9dcf-4813-81cf-128603c7e395 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:13.681817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1a7f-9dcf-4813-81cf-128603c7e395 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:13.681919 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1a7f-9dcf-4813-81cf-128603c7e395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:13.711699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:13.757026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a32a1a7f-9dcf-4813-81cf-128603c7e395 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:13.758295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a32a1a7f-9dcf-4813-81cf-128603c7e395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:13.880837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 718/1405] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:14.185453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de1c78-1a2e-455b-93ed-3b75bce2287b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:14.190932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c9de1c78-1a2e-455b-93ed-3b75bce2287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:14.360663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de1c78-1a2e-455b-93ed-3b75bce2287b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:14.410240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:14.495580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e31d29-f04e-4a96-a9b1-72d3290eeed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:14.496194 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e31d29-f04e-4a96-a9b1-72d3290eeed4 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:14.496482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e31d29-f04e-4a96-a9b1-72d3290eeed4 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:14.496761 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e31d29-f04e-4a96-a9b1-72d3290eeed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:14.498442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-18e31d29-f04e-4a96-a9b1-72d3290eeed4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:14.604747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e31d29-f04e-4a96-a9b1-72d3290eeed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:14.606379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e31d29-f04e-4a96-a9b1-72d3290eeed4 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:14.630168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 688/1406] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:16.790147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434c60-0c8e-431f-8c18-1547e6c09297 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:16.790768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434c60-0c8e-431f-8c18-1547e6c09297 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:16.790989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434c60-0c8e-431f-8c18-1547e6c09297 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:16.792516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 719/1407] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:16.798537 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac94b-99a4-4b11-8a00-b4732d309de5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:16.798986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac94b-99a4-4b11-8a00-b4732d309de5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:16.799114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac94b-99a4-4b11-8a00-b4732d309de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:16.874363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:16.882215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-329ac94b-99a4-4b11-8a00-b4732d309de5 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:16.883593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-329ac94b-99a4-4b11-8a00-b4732d309de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:16.995961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 689/1408] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:17.285641 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed434c60-0c8e-431f-8c18-1547e6c09297 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:17.287297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed434c60-0c8e-431f-8c18-1547e6c09297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:17.413171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:17.471892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed434c60-0c8e-431f-8c18-1547e6c09297 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:17.602082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4569f2-cdaf-4ee5-999d-17d9dd7f4513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:17.603078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4569f2-cdaf-4ee5-999d-17d9dd7f4513 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:17.603362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4569f2-cdaf-4ee5-999d-17d9dd7f4513 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:17.603643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4569f2-cdaf-4ee5-999d-17d9dd7f4513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:17.605308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0c4569f2-cdaf-4ee5-999d-17d9dd7f4513 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:17.675396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:17.708046 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4569f2-cdaf-4ee5-999d-17d9dd7f4513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:17.709962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4569f2-cdaf-4ee5-999d-17d9dd7f4513 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:17.729692 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 720/1409] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:26.993762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=44 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:27.736435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=18 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:34.448884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d28479-c9fa-48ad-bca9-dad257de41ba None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:34.449450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d28479-c9fa-48ad-bca9-dad257de41ba None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:34.449450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d28479-c9fa-48ad-bca9-dad257de41ba None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:34.450861 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 690/1410] 10.222.0.88 () {54 vars in 918 bytes} [Wed Aug 24 03:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:34.456088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fb164-bdf8-437c-93e4-1821577a7418 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:34.456520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fb164-bdf8-437c-93e4-1821577a7418 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:34.456629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fb164-bdf8-437c-93e4-1821577a7418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:34.536340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e25fb164-bdf8-437c-93e4-1821577a7418 None None] MFA Rules not processed for user `e686e974721345eba4de46cde2edaf34`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:34.537598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e25fb164-bdf8-437c-93e4-1821577a7418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:34.644585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 721/1411] 10.222.0.88 () {58 vars in 1015 bytes} [Wed Aug 24 03:41:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:34.659202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0228aa7-186d-4bbb-815c-da50a3cf8693 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:34.659488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0228aa7-186d-4bbb-815c-da50a3cf8693 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:34.659763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0228aa7-186d-4bbb-815c-da50a3cf8693 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:34.661169 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 691/1412] 10.222.0.88 () {54 vars in 918 bytes} [Wed Aug 24 03:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:34.665704 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5c55b-4579-424e-9b72-7038836c7abb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:34.665992 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5c55b-4579-424e-9b72-7038836c7abb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:34.666272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5c55b-4579-424e-9b72-7038836c7abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:34.740181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:34.742757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0ee5c55b-4579-424e-9b72-7038836c7abb None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:34.744017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ee5c55b-4579-424e-9b72-7038836c7abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:34.859642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 722/1413] 10.222.0.88 () {58 vars in 1015 bytes} [Wed Aug 24 03:41:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:37.241483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc8c5-cd9d-4ced-9f20-4be2237847cb None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.242076 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc8c5-cd9d-4ced-9f20-4be2237847cb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.242076 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc8c5-cd9d-4ced-9f20-4be2237847cb None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.243437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 692/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:37.249530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dadaa-ab80-4050-9450-16ea3368ac33 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.249968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dadaa-ab80-4050-9450-16ea3368ac33 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.250074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dadaa-ab80-4050-9450-16ea3368ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.317270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-149dadaa-ab80-4050-9450-16ea3368ac33 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:37.318501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-149dadaa-ab80-4050-9450-16ea3368ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:37.374234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:37.419250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 723/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:37.718963 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc8c5-cd9d-4ced-9f20-4be2237847cb None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:37.720854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-13cfc8c5-cd9d-4ced-9f20-4be2237847cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:37.868539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc8c5-cd9d-4ced-9f20-4be2237847cb None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:37.940509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:37.981798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790fd32-e921-406a-8910-a6fcdbc00379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:37.982332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790fd32-e921-406a-8910-a6fcdbc00379 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.982611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790fd32-e921-406a-8910-a6fcdbc00379 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.982882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790fd32-e921-406a-8910-a6fcdbc00379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.984537 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d790fd32-e921-406a-8910-a6fcdbc00379 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:38.072186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790fd32-e921-406a-8910-a6fcdbc00379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:38.073789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790fd32-e921-406a-8910-a6fcdbc00379 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:38.093765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 693/1416] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:38.996065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d386a-1b5a-495a-a0b7-37218e888352 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:38.996530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d386a-1b5a-495a-a0b7-37218e888352 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:38.996627 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d386a-1b5a-495a-a0b7-37218e888352 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:38.998536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 724/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:39.003570 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b5bd9-c2c9-48f3-a80d-29a51d763d0c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:39.004003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b5bd9-c2c9-48f3-a80d-29a51d763d0c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:39.004109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b5bd9-c2c9-48f3-a80d-29a51d763d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:39.087782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a45b5bd9-c2c9-48f3-a80d-29a51d763d0c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:39.089003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a45b5bd9-c2c9-48f3-a80d-29a51d763d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:39.117271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:39.188439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 694/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:39.338338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d386a-1b5a-495a-a0b7-37218e888352 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:39.339833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f92d386a-1b5a-495a-a0b7-37218e888352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:39.488793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d386a-1b5a-495a-a0b7-37218e888352 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:39.529069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:39.605159 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07ac42-0269-4121-8f4c-4707aaf998c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:39.605686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07ac42-0269-4121-8f4c-4707aaf998c6 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:39.605980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07ac42-0269-4121-8f4c-4707aaf998c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:39.606236 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07ac42-0269-4121-8f4c-4707aaf998c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:39.607896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3c07ac42-0269-4121-8f4c-4707aaf998c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:39.696359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07ac42-0269-4121-8f4c-4707aaf998c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:39.698013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07ac42-0269-4121-8f4c-4707aaf998c6 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:39.716869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 725/1419] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:40.621096 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08c9ff-ecd7-414d-87a5-8e627f4ddab4 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:40.621679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08c9ff-ecd7-414d-87a5-8e627f4ddab4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:40.621679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08c9ff-ecd7-414d-87a5-8e627f4ddab4 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:40.623059 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 695/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:40.628174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917a1a-80c1-4275-ae68-e7cd99d00c95 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:40.628637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917a1a-80c1-4275-ae68-e7cd99d00c95 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:40.628829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917a1a-80c1-4275-ae68-e7cd99d00c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:40.684284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:40.705368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1b917a1a-80c1-4275-ae68-e7cd99d00c95 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:40.706575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1b917a1a-80c1-4275-ae68-e7cd99d00c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:40.812232 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 726/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:40.963999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08c9ff-ecd7-414d-87a5-8e627f4ddab4 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:40.965518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6b08c9ff-ecd7-414d-87a5-8e627f4ddab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:41.115230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08c9ff-ecd7-414d-87a5-8e627f4ddab4 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:41.128413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:41.229682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e38b3-58d5-4136-8e78-de6205951894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:41.230212 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e38b3-58d5-4136-8e78-de6205951894 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:41.230608 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e38b3-58d5-4136-8e78-de6205951894 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:41.230887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e38b3-58d5-4136-8e78-de6205951894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:41.233089 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f38e38b3-58d5-4136-8e78-de6205951894 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:41.322149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e38b3-58d5-4136-8e78-de6205951894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:41.323793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e38b3-58d5-4136-8e78-de6205951894 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:41.341941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 696/1422] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:42.211929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f268e2-8d91-4739-91bb-92b38fced82b None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:42.212485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f268e2-8d91-4739-91bb-92b38fced82b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:42.212485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f268e2-8d91-4739-91bb-92b38fced82b None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:42.213880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 727/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:42.218910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04123613-04ea-4a64-8f8a-a861d873551e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:42.219345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04123613-04ea-4a64-8f8a-a861d873551e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:42.219479 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04123613-04ea-4a64-8f8a-a861d873551e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:42.239282 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:42.295965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-04123613-04ea-4a64-8f8a-a861d873551e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:42.297194 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-04123613-04ea-4a64-8f8a-a861d873551e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:42.403594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 697/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:42.554691 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f268e2-8d91-4739-91bb-92b38fced82b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:42.556464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-65f268e2-8d91-4739-91bb-92b38fced82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:42.668232 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:42.705157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f268e2-8d91-4739-91bb-92b38fced82b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:42.817526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c308e37-b88f-4c84-bac7-6a28e3a7b9ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:42.818056 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c308e37-b88f-4c84-bac7-6a28e3a7b9ca service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:42.818340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c308e37-b88f-4c84-bac7-6a28e3a7b9ca service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:42.818614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c308e37-b88f-4c84-bac7-6a28e3a7b9ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:42.820270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c308e37-b88f-4c84-bac7-6a28e3a7b9ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:42.896391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:42.910448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c308e37-b88f-4c84-bac7-6a28e3a7b9ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:42.912163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c308e37-b88f-4c84-bac7-6a28e3a7b9ca service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:42.930716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 728/1425] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:43.795970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5573c-533c-4848-9102-afe337ed7af8 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:43.796564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5573c-533c-4848-9102-afe337ed7af8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:43.796564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5573c-533c-4848-9102-afe337ed7af8 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:43.797960 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 698/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:43.803293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b25fb-a8fc-4d36-9d6d-755241691a04 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:43.803837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b25fb-a8fc-4d36-9d6d-755241691a04 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:43.803837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b25fb-a8fc-4d36-9d6d-755241691a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:43.881728 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-fd2b25fb-a8fc-4d36-9d6d-755241691a04 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:43.882946 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fd2b25fb-a8fc-4d36-9d6d-755241691a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:43.980203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 729/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:44.134095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5573c-533c-4848-9102-afe337ed7af8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:44.135523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-23d5573c-533c-4848-9102-afe337ed7af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:44.221302 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:44.286248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5573c-533c-4848-9102-afe337ed7af8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:44.400031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4d989-13f9-45d7-a82c-fefbdb595b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:44.400571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4d989-13f9-45d7-a82c-fefbdb595b23 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:44.400846 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4d989-13f9-45d7-a82c-fefbdb595b23 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:44.401254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4d989-13f9-45d7-a82c-fefbdb595b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:44.402885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e7b4d989-13f9-45d7-a82c-fefbdb595b23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:44.452206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:44.491466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4d989-13f9-45d7-a82c-fefbdb595b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:44.493068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4d989-13f9-45d7-a82c-fefbdb595b23 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:44.512003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 699/1428] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:45.468468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537ad9-f373-4d93-9498-f42971f1f9c6 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:45.468928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537ad9-f373-4d93-9498-f42971f1f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:45.469033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537ad9-f373-4d93-9498-f42971f1f9c6 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:45.470682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 730/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:45.475616 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c1b86-333b-44e7-b5c8-e9e63aa72bb9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:45.476070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c1b86-333b-44e7-b5c8-e9e63aa72bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:45.476184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c1b86-333b-44e7-b5c8-e9e63aa72bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:45.551221 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-078c1b86-333b-44e7-b5c8-e9e63aa72bb9 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:45.552437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-078c1b86-333b-44e7-b5c8-e9e63aa72bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:45.660794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 700/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:45.811656 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1537ad9-f373-4d93-9498-f42971f1f9c6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:45.813176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e1537ad9-f373-4d93-9498-f42971f1f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:45.861934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:45.958139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1537ad9-f373-4d93-9498-f42971f1f9c6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:46.070767 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba6697-61db-4030-af09-e4a167bc8fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:46.071406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba6697-61db-4030-af09-e4a167bc8fa7 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:46.071690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba6697-61db-4030-af09-e4a167bc8fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:46.071992 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba6697-61db-4030-af09-e4a167bc8fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:46.073606 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9eba6697-61db-4030-af09-e4a167bc8fa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:46.081137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:46.163185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba6697-61db-4030-af09-e4a167bc8fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:46.164797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba6697-61db-4030-af09-e4a167bc8fa7 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:46.182877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 731/1431] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:47.070500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3396-3f81-41b5-9930-2be952e17693 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:47.071169 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3396-3f81-41b5-9930-2be952e17693 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:47.071169 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3396-3f81-41b5-9930-2be952e17693 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:47.072467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 701/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:47.077885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e13ca6-87a5-4728-abc5-9f169b92b9bf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:47.078336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e13ca6-87a5-4728-abc5-9f169b92b9bf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:47.078452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e13ca6-87a5-4728-abc5-9f169b92b9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:47.273030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f9e13ca6-87a5-4728-abc5-9f169b92b9bf None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:47.274253 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f9e13ca6-87a5-4728-abc5-9f169b92b9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:47.342969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:47.372145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 732/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:47.556698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee3396-3f81-41b5-9930-2be952e17693 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:47.558169 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-45ee3396-3f81-41b5-9930-2be952e17693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:47.576686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:47.707713 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee3396-3f81-41b5-9930-2be952e17693 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:47.794634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:47.821205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ce700-1263-4cb1-ac3c-bd0ca4fbfb58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:47.822112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ce700-1263-4cb1-ac3c-bd0ca4fbfb58 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:47.822390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ce700-1263-4cb1-ac3c-bd0ca4fbfb58 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:47.822662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ce700-1263-4cb1-ac3c-bd0ca4fbfb58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:47.824414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5b4ce700-1263-4cb1-ac3c-bd0ca4fbfb58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:47.915155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ce700-1263-4cb1-ac3c-bd0ca4fbfb58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:47.916755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ce700-1263-4cb1-ac3c-bd0ca4fbfb58 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:47.935493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 702/1434] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:48.851425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00db6-28a5-4103-9427-1ac105fec6f8 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:48.851998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00db6-28a5-4103-9427-1ac105fec6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:48.851998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00db6-28a5-4103-9427-1ac105fec6f8 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:48.853340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 733/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:48.860605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d88b2f-031c-416d-8530-cbda545a9938 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:48.861105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d88b2f-031c-416d-8530-cbda545a9938 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:48.861217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d88b2f-031c-416d-8530-cbda545a9938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:48.961478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-75d88b2f-031c-416d-8530-cbda545a9938 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:48.962715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-75d88b2f-031c-416d-8530-cbda545a9938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:49.004347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:49.059367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 703/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:49.211693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee00db6-28a5-4103-9427-1ac105fec6f8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:49.213239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1ee00db6-28a5-4103-9427-1ac105fec6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:49.367518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee00db6-28a5-4103-9427-1ac105fec6f8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:49.421026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:49.481152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847f537-f9f1-4e58-be71-93a8c64ffca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:49.481152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847f537-f9f1-4e58-be71-93a8c64ffca0 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:49.481473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847f537-f9f1-4e58-be71-93a8c64ffca0 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:49.481473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847f537-f9f1-4e58-be71-93a8c64ffca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:49.483099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d847f537-f9f1-4e58-be71-93a8c64ffca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:49.577951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847f537-f9f1-4e58-be71-93a8c64ffca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:49.579626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847f537-f9f1-4e58-be71-93a8c64ffca0 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:49.598370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 734/1437] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:50.445587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2e78-9c18-420a-8f5c-c0b6fa10da42 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.446142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2e78-9c18-420a-8f5c-c0b6fa10da42 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.446142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2e78-9c18-420a-8f5c-c0b6fa10da42 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.447520 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 704/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:50.453076 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9f77-2a98-4fa1-a17d-604f1d5db5bd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.453479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9f77-2a98-4fa1-a17d-604f1d5db5bd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.453626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9f77-2a98-4fa1-a17d-604f1d5db5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.528177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9d9b9f77-2a98-4fa1-a17d-604f1d5db5bd None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:50.529408 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9d9b9f77-2a98-4fa1-a17d-604f1d5db5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:50.531468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:50.625784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 735/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:50.780045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e2e78-9c18-420a-8f5c-c0b6fa10da42 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:50.781562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-070e2e78-9c18-420a-8f5c-c0b6fa10da42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:50.929195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e2e78-9c18-420a-8f5c-c0b6fa10da42 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:50.956010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:51.041894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f9a79-3039-4829-9016-815c7dea5330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:51.042419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f9a79-3039-4829-9016-815c7dea5330 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:51.042700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f9a79-3039-4829-9016-815c7dea5330 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:51.042973 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f9a79-3039-4829-9016-815c7dea5330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:51.045131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-236f9a79-3039-4829-9016-815c7dea5330 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:51.133288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f9a79-3039-4829-9016-815c7dea5330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:51.134893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f9a79-3039-4829-9016-815c7dea5330 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:51.153316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 705/1440] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:52.983994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff9eb-eec3-43ef-b0b8-a6e629ec0be5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:52.984460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff9eb-eec3-43ef-b0b8-a6e629ec0be5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:52.984566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff9eb-eec3-43ef-b0b8-a6e629ec0be5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:52.985905 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 736/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:52.991208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e327ef3-6c96-4b26-86bd-830186a1ee08 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:52.991639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e327ef3-6c96-4b26-86bd-830186a1ee08 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:52.991763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e327ef3-6c96-4b26-86bd-830186a1ee08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:53.032854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:53.057440 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0e327ef3-6c96-4b26-86bd-830186a1ee08 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:53.058690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0e327ef3-6c96-4b26-86bd-830186a1ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:53.154889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 706/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:53.439501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aff9eb-eec3-43ef-b0b8-a6e629ec0be5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:53.441169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96aff9eb-eec3-43ef-b0b8-a6e629ec0be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:53.545235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aff9eb-eec3-43ef-b0b8-a6e629ec0be5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:53.577118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:53.618135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2656a-a7c8-441a-9ae4-30dc46ee4c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:53.618744 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2656a-a7c8-441a-9ae4-30dc46ee4c2f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:53.619023 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2656a-a7c8-441a-9ae4-30dc46ee4c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:53.619324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2656a-a7c8-441a-9ae4-30dc46ee4c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:53.620930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3cb2656a-a7c8-441a-9ae4-30dc46ee4c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:53.734698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2656a-a7c8-441a-9ae4-30dc46ee4c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:53.736258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2656a-a7c8-441a-9ae4-30dc46ee4c2f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:53.754425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 737/1443] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:55.858441 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0b4ba-cb91-4adb-a57d-684406866588 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:55.859004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0b4ba-cb91-4adb-a57d-684406866588 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:55.859004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0b4ba-cb91-4adb-a57d-684406866588 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:55.860367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 707/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:55.865722 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf41b-4944-452e-9189-9dfd3a1cbf94 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:55.866235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf41b-4944-452e-9189-9dfd3a1cbf94 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:55.866338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf41b-4944-452e-9189-9dfd3a1cbf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:55.933400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e32cf41b-4944-452e-9189-9dfd3a1cbf94 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:55.935151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e32cf41b-4944-452e-9189-9dfd3a1cbf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:55.947852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:56.033086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 738/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:56.312817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0b4ba-cb91-4adb-a57d-684406866588 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:56.314412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d3a0b4ba-cb91-4adb-a57d-684406866588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:56.442469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0b4ba-cb91-4adb-a57d-684406866588 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:56.455126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:56.517189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10314ea8-a207-4a98-a9e6-28db70ca91d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:56.517798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10314ea8-a207-4a98-a9e6-28db70ca91d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:56.518077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10314ea8-a207-4a98-a9e6-28db70ca91d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:56.518348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10314ea8-a207-4a98-a9e6-28db70ca91d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:56.519978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-10314ea8-a207-4a98-a9e6-28db70ca91d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:56.626853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10314ea8-a207-4a98-a9e6-28db70ca91d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:56.628248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10314ea8-a207-4a98-a9e6-28db70ca91d0 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:56.646673 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 708/1446] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:58.918879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452c554-7cdb-47e3-bf3d-7bcf72935ced None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:58.919454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452c554-7cdb-47e3-bf3d-7bcf72935ced None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:58.919454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452c554-7cdb-47e3-bf3d-7bcf72935ced None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:58.920824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 739/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:58.926151 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754632e-cb9e-417f-a47d-e2144728090f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:58.926556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754632e-cb9e-417f-a47d-e2144728090f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:58.926726 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754632e-cb9e-417f-a47d-e2144728090f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:58.974367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:58.993071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6754632e-cb9e-417f-a47d-e2144728090f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:58.994292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6754632e-cb9e-417f-a47d-e2144728090f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:59.089948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 709/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:59.374596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452c554-7cdb-47e3-bf3d-7bcf72935ced None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:59.376378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8452c554-7cdb-47e3-bf3d-7bcf72935ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:59.479321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452c554-7cdb-47e3-bf3d-7bcf72935ced None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:59.519683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:59.552529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad68f89-09ac-472f-a32b-2271a4c17732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:59.553324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad68f89-09ac-472f-a32b-2271a4c17732 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:59.553859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad68f89-09ac-472f-a32b-2271a4c17732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:59.554155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad68f89-09ac-472f-a32b-2271a4c17732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:59.556178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ad68f89-09ac-472f-a32b-2271a4c17732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:59.667486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad68f89-09ac-472f-a32b-2271a4c17732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:59.668948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad68f89-09ac-472f-a32b-2271a4c17732 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:59.688922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 740/1449] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:01.702561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d1127-6d91-4486-b32e-c66147ac31eb None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.703353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d1127-6d91-4486-b32e-c66147ac31eb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.703353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d1127-6d91-4486-b32e-c66147ac31eb None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.704584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 710/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:01.709788 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6a5f7-ef84-46c6-a7a0-274a9481e6b2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:01.710198 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6a5f7-ef84-46c6-a7a0-274a9481e6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:01.710308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6a5f7-ef84-46c6-a7a0-274a9481e6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:01.775677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5aa6a5f7-ef84-46c6-a7a0-274a9481e6b2 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:01.776883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5aa6a5f7-ef84-46c6-a7a0-274a9481e6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:01.797083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:01.875315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 741/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:02.155146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d1127-6d91-4486-b32e-c66147ac31eb None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:02.156727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1d3d1127-6d91-4486-b32e-c66147ac31eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:02.262054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d1127-6d91-4486-b32e-c66147ac31eb None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:02.282898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:02.338725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e5884-cbf6-4f16-9b06-8f44b38a896c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:02.339373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e5884-cbf6-4f16-9b06-8f44b38a896c service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:02.340142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e5884-cbf6-4f16-9b06-8f44b38a896c service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:02.340414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e5884-cbf6-4f16-9b06-8f44b38a896c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:02.342060 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-869e5884-cbf6-4f16-9b06-8f44b38a896c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:02.450909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e5884-cbf6-4f16-9b06-8f44b38a896c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:02.452316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e5884-cbf6-4f16-9b06-8f44b38a896c service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:02.471001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 711/1452] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:04.420583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad65c2-1a52-4637-87cd-dbe192159d83 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:04.421170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad65c2-1a52-4637-87cd-dbe192159d83 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:04.421170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad65c2-1a52-4637-87cd-dbe192159d83 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:04.422488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 742/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:04.428165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7bf41-6c15-4d12-8847-c9da93c71e8d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:04.428723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7bf41-6c15-4d12-8847-c9da93c71e8d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:04.428723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7bf41-6c15-4d12-8847-c9da93c71e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:04.492419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:04.495309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b6a7bf41-6c15-4d12-8847-c9da93c71e8d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:04.496566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b6a7bf41-6c15-4d12-8847-c9da93c71e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:04.594942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 712/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:04.885356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad65c2-1a52-4637-87cd-dbe192159d83 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:04.887650 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-45ad65c2-1a52-4637-87cd-dbe192159d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:04.989480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad65c2-1a52-4637-87cd-dbe192159d83 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:05.038105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:05.062597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f9846-97dd-404f-bfb5-ae5a8cddaeb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:05.063237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f9846-97dd-404f-bfb5-ae5a8cddaeb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:05.063534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f9846-97dd-404f-bfb5-ae5a8cddaeb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:05.063789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f9846-97dd-404f-bfb5-ae5a8cddaeb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:05.065570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-481f9846-97dd-404f-bfb5-ae5a8cddaeb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:05.179711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f9846-97dd-404f-bfb5-ae5a8cddaeb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:05.181080 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f9846-97dd-404f-bfb5-ae5a8cddaeb9 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:05.199457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 743/1455] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:07.159826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376804-a5db-49fc-b364-e3c2478fe75d None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:07.160388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376804-a5db-49fc-b364-e3c2478fe75d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:07.160388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376804-a5db-49fc-b364-e3c2478fe75d None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:07.161652 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 713/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:42:07.167145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039ccf5-c37f-4000-8860-ca905f6b0923 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:07.168099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039ccf5-c37f-4000-8860-ca905f6b0923 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:07.168215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039ccf5-c37f-4000-8860-ca905f6b0923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:07.235682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4039ccf5-c37f-4000-8860-ca905f6b0923 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:07.236893 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4039ccf5-c37f-4000-8860-ca905f6b0923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:07.266001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:07.333788 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 744/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:07.618322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc376804-a5db-49fc-b364-e3c2478fe75d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:07.619917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fc376804-a5db-49fc-b364-e3c2478fe75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:07.723199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc376804-a5db-49fc-b364-e3c2478fe75d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:07.752492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:07.798309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b9e65-77e4-40eb-a3f9-83d4ff26c1d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:07.798914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b9e65-77e4-40eb-a3f9-83d4ff26c1d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:07.799229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b9e65-77e4-40eb-a3f9-83d4ff26c1d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:07.799508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b9e65-77e4-40eb-a3f9-83d4ff26c1d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:07.801108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d70b9e65-77e4-40eb-a3f9-83d4ff26c1d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:07.908976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b9e65-77e4-40eb-a3f9-83d4ff26c1d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:07.910437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b9e65-77e4-40eb-a3f9-83d4ff26c1d4 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:07.940416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 714/1458] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:09.885447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d9a3-251e-46ae-935f-6183e0705178 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:09.885915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d9a3-251e-46ae-935f-6183e0705178 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:09.886531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d9a3-251e-46ae-935f-6183e0705178 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:09.887899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 745/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:09.893247 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4593-06e8-4fe3-b14f-28e3bdd31d02 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:09.893684 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4593-06e8-4fe3-b14f-28e3bdd31d02 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:09.893813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4593-06e8-4fe3-b14f-28e3bdd31d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:09.960228 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1fca4593-06e8-4fe3-b14f-28e3bdd31d02 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:09.961426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1fca4593-06e8-4fe3-b14f-28e3bdd31d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:09.970841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:10.057728 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 715/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:10.341967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28d9a3-251e-46ae-935f-6183e0705178 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:10.343549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ad28d9a3-251e-46ae-935f-6183e0705178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:10.450656 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28d9a3-251e-46ae-935f-6183e0705178 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:10.507265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:10.525379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e2d3a-6692-4882-9d66-2c188fc171b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:10.525987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2d3a-6692-4882-9d66-2c188fc171b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:10.526266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2d3a-6692-4882-9d66-2c188fc171b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:10.526539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2d3a-6692-4882-9d66-2c188fc171b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:10.528686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-136e2d3a-6692-4882-9d66-2c188fc171b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:10.637853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e2d3a-6692-4882-9d66-2c188fc171b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:10.639249 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e2d3a-6692-4882-9d66-2c188fc171b7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:10.658048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 746/1461] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:12.670859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b992-413b-415f-b660-d30cd251c17b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:12.671462 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b992-413b-415f-b660-d30cd251c17b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:12.671462 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b992-413b-415f-b660-d30cd251c17b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:12.672842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 716/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:12.678381 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667788c-7b4e-4e83-9f73-4c9820d3378b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:12.678802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667788c-7b4e-4e83-9f73-4c9820d3378b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:12.678937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667788c-7b4e-4e83-9f73-4c9820d3378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:12.744991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4667788c-7b4e-4e83-9f73-4c9820d3378b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:12.746635 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4667788c-7b4e-4e83-9f73-4c9820d3378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:12.785939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:12.845719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 747/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:13.124689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8b992-413b-415f-b660-d30cd251c17b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:13.126279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-44d8b992-413b-415f-b660-d30cd251c17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:13.235561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8b992-413b-415f-b660-d30cd251c17b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:13.274426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:13.311518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b079630-ce31-4a9f-80be-547c59d06e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:13.312146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b079630-ce31-4a9f-80be-547c59d06e4f service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:13.312431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b079630-ce31-4a9f-80be-547c59d06e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:13.312706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b079630-ce31-4a9f-80be-547c59d06e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:13.314316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2b079630-ce31-4a9f-80be-547c59d06e4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:13.426831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b079630-ce31-4a9f-80be-547c59d06e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:13.428236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b079630-ce31-4a9f-80be-547c59d06e4f service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:13.446380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 717/1464] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:15.395821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88900a86-a40e-4d09-9414-c1aa314832cc None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:15.396430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88900a86-a40e-4d09-9414-c1aa314832cc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:15.396430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88900a86-a40e-4d09-9414-c1aa314832cc None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:15.397684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 748/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:15.403971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707e35-cdba-4fdc-aafb-8036b428b94e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:15.404435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707e35-cdba-4fdc-aafb-8036b428b94e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:15.404593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707e35-cdba-4fdc-aafb-8036b428b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:15.477976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b8707e35-cdba-4fdc-aafb-8036b428b94e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:15.479244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b8707e35-cdba-4fdc-aafb-8036b428b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:15.497545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:15.575580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 718/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:15.857970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88900a86-a40e-4d09-9414-c1aa314832cc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:15.859558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-88900a86-a40e-4d09-9414-c1aa314832cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:15.963446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88900a86-a40e-4d09-9414-c1aa314832cc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:16.034390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:16.041206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6a082-3e46-4cb8-81cc-d17a87688e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:16.051447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a082-3e46-4cb8-81cc-d17a87688e0c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:16.051447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a082-3e46-4cb8-81cc-d17a87688e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:16.051447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a082-3e46-4cb8-81cc-d17a87688e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:16.051447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-53d6a082-3e46-4cb8-81cc-d17a87688e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:16.162507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6a082-3e46-4cb8-81cc-d17a87688e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:16.163898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6a082-3e46-4cb8-81cc-d17a87688e0c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:16.181798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 749/1467] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:18.101508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66fea5-1445-423c-a1e9-f8489b4f3673 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:18.102072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66fea5-1445-423c-a1e9-f8489b4f3673 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:18.102072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66fea5-1445-423c-a1e9-f8489b4f3673 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:18.103438 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 719/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:18.109220 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861cd6-0adf-4ec7-aed7-45e2d5548bdf None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:18.109690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861cd6-0adf-4ec7-aed7-45e2d5548bdf None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:18.109807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861cd6-0adf-4ec7-aed7-45e2d5548bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:18.175324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5d861cd6-0adf-4ec7-aed7-45e2d5548bdf None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:18.176468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5d861cd6-0adf-4ec7-aed7-45e2d5548bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:18.224333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:18.273036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 750/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:18.558406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66fea5-1445-423c-a1e9-f8489b4f3673 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:18.560028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1c66fea5-1445-423c-a1e9-f8489b4f3673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:18.662871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66fea5-1445-423c-a1e9-f8489b4f3673 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:18.710100 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:18.737865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed60ce-04b9-4971-88ba-0a266be84a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:18.738483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed60ce-04b9-4971-88ba-0a266be84a2b service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:18.738767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed60ce-04b9-4971-88ba-0a266be84a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:18.739066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed60ce-04b9-4971-88ba-0a266be84a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:18.741382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-34ed60ce-04b9-4971-88ba-0a266be84a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:18.858749 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed60ce-04b9-4971-88ba-0a266be84a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:18.860160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed60ce-04b9-4971-88ba-0a266be84a2b service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:18.878925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 720/1470] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:28.271201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=22 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:28.876579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=66 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:38.386026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb5dfd-96bd-43e4-9ec1-964a6ef3aafa None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.386597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb5dfd-96bd-43e4-9ec1-964a6ef3aafa None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.386597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb5dfd-96bd-43e4-9ec1-964a6ef3aafa None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.387990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 751/1471] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:38.393463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760693c-23ec-4d55-b016-18e7e41c6883 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.393890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760693c-23ec-4d55-b016-18e7e41c6883 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.393993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760693c-23ec-4d55-b016-18e7e41c6883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.459695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8760693c-23ec-4d55-b016-18e7e41c6883 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:38.460908 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8760693c-23ec-4d55-b016-18e7e41c6883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:38.555691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 721/1472] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:38.853440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07de81-ce39-4bd7-8924-979dfe8d603e None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.854335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07de81-ce39-4bd7-8924-979dfe8d603e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.854615 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07de81-ce39-4bd7-8924-979dfe8d603e None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.856094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 752/1473] 10.222.0.88 () {54 vars in 967 bytes} [Wed Aug 24 03:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:38.860946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f068d6-d993-43ed-8143-151d6eef19de None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.861258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f068d6-d993-43ed-8143-151d6eef19de None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.861534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f068d6-d993-43ed-8143-151d6eef19de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.937318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-29f068d6-d993-43ed-8143-151d6eef19de None None] MFA Rules not processed for user `6955fc5b81a040f686e21621ea968a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:38.938543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-29f068d6-d993-43ed-8143-151d6eef19de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:38.958944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:39.016640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 722/1474] 10.222.0.88 () {58 vars in 1064 bytes} [Wed Aug 24 03:42:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:39.024234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07de81-ce39-4bd7-8924-979dfe8d603e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:39.025818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7a07de81-ce39-4bd7-8924-979dfe8d603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:39.128482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07de81-ce39-4bd7-8924-979dfe8d603e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:39.199785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5463a50-a0b6-450c-93ed-68f94a60ccad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6955fc5b81a040f686e21621ea968a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:39.200390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5463a50-a0b6-450c-93ed-68f94a60ccad service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:39.200667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5463a50-a0b6-450c-93ed-68f94a60ccad service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:39.200938 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5463a50-a0b6-450c-93ed-68f94a60ccad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:39.202521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a5463a50-a0b6-450c-93ed-68f94a60ccad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:39.259464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:39.316049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5463a50-a0b6-450c-93ed-68f94a60ccad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:39.317517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5463a50-a0b6-450c-93ed-68f94a60ccad service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:39.335894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 753/1475] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:41.377579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d82df-8f04-46ee-8fa1-889f0b4e6184 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:41.378121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d82df-8f04-46ee-8fa1-889f0b4e6184 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:41.378121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d82df-8f04-46ee-8fa1-889f0b4e6184 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:41.379553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 723/1476] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:41.385065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008015dc-bcc5-43fd-9bdb-51f931d5b297 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:41.385490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008015dc-bcc5-43fd-9bdb-51f931d5b297 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:41.385595 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008015dc-bcc5-43fd-9bdb-51f931d5b297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:41.450289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-008015dc-bcc5-43fd-9bdb-51f931d5b297 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:41.451520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-008015dc-bcc5-43fd-9bdb-51f931d5b297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:41.549229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 754/1477] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:41.825747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d82df-8f04-46ee-8fa1-889f0b4e6184 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:41.827348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9f5d82df-8f04-46ee-8fa1-889f0b4e6184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:41.954723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d82df-8f04-46ee-8fa1-889f0b4e6184 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:42.002863 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:42.046208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2039b-fe21-422a-956c-eb1f66420de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:42.046822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2039b-fe21-422a-956c-eb1f66420de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:42.047137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2039b-fe21-422a-956c-eb1f66420de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:42.047409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2039b-fe21-422a-956c-eb1f66420de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:42.048062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2039b-fe21-422a-956c-eb1f66420de9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:42.050656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-2dd2039b-fe21-422a-956c-eb1f66420de9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:42:42.050656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Aug 24 03:42:42.050656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: Aug 24 03:42:42.051843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2039b-fe21-422a-956c-eb1f66420de9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:42.070929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 724/1478] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 03:42:41 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:44.090223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42514d4-3a3e-4757-871d-875f5474f1c5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:44.090793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42514d4-3a3e-4757-871d-875f5474f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:44.090793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42514d4-3a3e-4757-871d-875f5474f1c5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:44.092211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 755/1479] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:44.097884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58241fe8-342f-4f8e-ad7a-74cec9378e40 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:44.098280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58241fe8-342f-4f8e-ad7a-74cec9378e40 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:44.098434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58241fe8-342f-4f8e-ad7a-74cec9378e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:44.164688 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-58241fe8-342f-4f8e-ad7a-74cec9378e40 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:44.165887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-58241fe8-342f-4f8e-ad7a-74cec9378e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:44.261678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 725/1480] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:44.565836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42514d4-3a3e-4757-871d-875f5474f1c5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:44.567450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b42514d4-3a3e-4757-871d-875f5474f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:44.577797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:44.719811 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42514d4-3a3e-4757-871d-875f5474f1c5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:44.800955 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:44.832524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e95cf7-e757-409d-a944-24eaac21b1a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:44.833221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95cf7-e757-409d-a944-24eaac21b1a2 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:44.833826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95cf7-e757-409d-a944-24eaac21b1a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:44.834100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95cf7-e757-409d-a944-24eaac21b1a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:44.835755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-46e95cf7-e757-409d-a944-24eaac21b1a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:44.926061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e95cf7-e757-409d-a944-24eaac21b1a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:44.927779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e95cf7-e757-409d-a944-24eaac21b1a2 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:44.946257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 756/1481] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:47.043849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895021a-935f-4b1a-b70d-69b631ddb87f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:47.044410 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895021a-935f-4b1a-b70d-69b631ddb87f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:47.044604 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895021a-935f-4b1a-b70d-69b631ddb87f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:47.045829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 726/1482] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:47.051222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349cb9c-b2a7-45c9-8bd5-2b90a13d8f05 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:47.051673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349cb9c-b2a7-45c9-8bd5-2b90a13d8f05 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:47.051786 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349cb9c-b2a7-45c9-8bd5-2b90a13d8f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:47.117229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b349cb9c-b2a7-45c9-8bd5-2b90a13d8f05 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:47.118497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b349cb9c-b2a7-45c9-8bd5-2b90a13d8f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:47.163814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:47.214265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 757/1483] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:47.501457 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895021a-935f-4b1a-b70d-69b631ddb87f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:47.503091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4895021a-935f-4b1a-b70d-69b631ddb87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:47.526481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:47.612266 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895021a-935f-4b1a-b70d-69b631ddb87f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:47.687526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb09e8-0561-4343-9d83-93f0ca226f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:47.688126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb09e8-0561-4343-9d83-93f0ca226f94 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:47.688403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb09e8-0561-4343-9d83-93f0ca226f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:47.688669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb09e8-0561-4343-9d83-93f0ca226f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:47.690265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-aceb09e8-0561-4343-9d83-93f0ca226f94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:47.764038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:47.798996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb09e8-0561-4343-9d83-93f0ca226f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:47.800513 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb09e8-0561-4343-9d83-93f0ca226f94 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:47.818839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 727/1484] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:49.827566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ee31-a441-44a1-86b1-ebec722b1d50 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:49.828148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ee31-a441-44a1-86b1-ebec722b1d50 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:49.828148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3ee31-a441-44a1-86b1-ebec722b1d50 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:49.829489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 758/1485] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:49.834765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54020-fc64-4cf2-b766-f40351639763 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:49.835272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54020-fc64-4cf2-b766-f40351639763 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:49.835379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54020-fc64-4cf2-b766-f40351639763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:49.902016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5bc54020-fc64-4cf2-b766-f40351639763 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:49.903264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5bc54020-fc64-4cf2-b766-f40351639763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:49.997478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 728/1486] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:50.292865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3ee31-a441-44a1-86b1-ebec722b1d50 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:50.294416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e5e3ee31-a441-44a1-86b1-ebec722b1d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:50.411960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3ee31-a441-44a1-86b1-ebec722b1d50 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:50.484517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:50.486289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a874816-ca5e-4d8a-9942-9b6bc19fe5fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:50.486927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a874816-ca5e-4d8a-9942-9b6bc19fe5fd service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:50.487222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a874816-ca5e-4d8a-9942-9b6bc19fe5fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:50.487500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a874816-ca5e-4d8a-9942-9b6bc19fe5fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:50.489136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0a874816-ca5e-4d8a-9942-9b6bc19fe5fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:50.597278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a874816-ca5e-4d8a-9942-9b6bc19fe5fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:50.598613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a874816-ca5e-4d8a-9942-9b6bc19fe5fd service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:50.617021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 759/1487] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:52.679431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31a4c0-6654-4b48-b7d0-53ef55f6a549 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:52.680082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31a4c0-6654-4b48-b7d0-53ef55f6a549 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:52.680082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31a4c0-6654-4b48-b7d0-53ef55f6a549 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:52.681880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 729/1488] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:52.687101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab7201-bf7c-421d-b519-795f1fe9175b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:52.687544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab7201-bf7c-421d-b519-795f1fe9175b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:52.687649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab7201-bf7c-421d-b519-795f1fe9175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:52.752332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-96ab7201-bf7c-421d-b519-795f1fe9175b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:52.753537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96ab7201-bf7c-421d-b519-795f1fe9175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:52.805915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:52.850395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 760/1489] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:53.143679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31a4c0-6654-4b48-b7d0-53ef55f6a549 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:53.145231 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4e31a4c0-6654-4b48-b7d0-53ef55f6a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:53.180497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:53.248699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31a4c0-6654-4b48-b7d0-53ef55f6a549 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:53.326541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2eb48-a678-4b64-a241-3610ef290120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:53.327068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2eb48-a678-4b64-a241-3610ef290120 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:53.327378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2eb48-a678-4b64-a241-3610ef290120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:53.327655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2eb48-a678-4b64-a241-3610ef290120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:53.329288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-69c2eb48-a678-4b64-a241-3610ef290120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:53.413026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:53.442583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2eb48-a678-4b64-a241-3610ef290120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:53.444074 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2eb48-a678-4b64-a241-3610ef290120 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:53.462814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 730/1490] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:55.795951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d2a5-a118-4c3c-bd82-385132ee0e34 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:55.796530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d2a5-a118-4c3c-bd82-385132ee0e34 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:55.796530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d2a5-a118-4c3c-bd82-385132ee0e34 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:55.797913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 761/1491] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 03:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:55.803174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24391-2292-4e6f-94a9-79b33bb50a32 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:55.803613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24391-2292-4e6f-94a9-79b33bb50a32 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:55.803719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24391-2292-4e6f-94a9-79b33bb50a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:55.870351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8cf24391-2292-4e6f-94a9-79b33bb50a32 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:55.871619 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8cf24391-2292-4e6f-94a9-79b33bb50a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:55.967488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 731/1492] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:42:56.255951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d2a5-a118-4c3c-bd82-385132ee0e34 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:56.257550 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-25f2d2a5-a118-4c3c-bd82-385132ee0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:56.361740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d2a5-a118-4c3c-bd82-385132ee0e34 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:56.435625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e2c76-7afc-4f71-bef7-398d0c64628d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:56.436232 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2c76-7afc-4f71-bef7-398d0c64628d service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:56.436507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2c76-7afc-4f71-bef7-398d0c64628d service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:56.436779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2c76-7afc-4f71-bef7-398d0c64628d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:56.438423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c72e2c76-7afc-4f71-bef7-398d0c64628d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:56.448521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:56.557179 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e2c76-7afc-4f71-bef7-398d0c64628d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:56.558525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e2c76-7afc-4f71-bef7-398d0c64628d service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:56.576338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 762/1493] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:05.965654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=82 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:06.574164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=50 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:16.957104 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d5522-f56e-4ba9-b43d-bbdcab2c1848 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:16.957663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d5522-f56e-4ba9-b43d-bbdcab2c1848 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:16.957663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d5522-f56e-4ba9-b43d-bbdcab2c1848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.033384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-217d5522-f56e-4ba9-b43d-bbdcab2c1848 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:17.034606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-217d5522-f56e-4ba9-b43d-bbdcab2c1848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.130363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 732/1494] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:17.138340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca42d22-3aef-4f59-92b2-5b5c3df43391 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.138833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca42d22-3aef-4f59-92b2-5b5c3df43391 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.138948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca42d22-3aef-4f59-92b2-5b5c3df43391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.214740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2ca42d22-3aef-4f59-92b2-5b5c3df43391 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:17.216176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ca42d22-3aef-4f59-92b2-5b5c3df43391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.313067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 763/1495] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:17.317738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d5522-f56e-4ba9-b43d-bbdcab2c1848 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:17.318947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-217d5522-f56e-4ba9-b43d-bbdcab2c1848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.330395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d5522-f56e-4ba9-b43d-bbdcab2c1848 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:17.397584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:17.431480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca607699-2a23-4d4a-bd8e-019b6e510cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:17.432094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca607699-2a23-4d4a-bd8e-019b6e510cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.432372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca607699-2a23-4d4a-bd8e-019b6e510cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.432646 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca607699-2a23-4d4a-bd8e-019b6e510cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.433294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca607699-2a23-4d4a-bd8e-019b6e510cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:44:17.433621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca607699-2a23-4d4a-bd8e-019b6e510cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:17.434694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-ca607699-2a23-4d4a-bd8e-019b6e510cb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:17.434694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Aug 24 03:44:17.434694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: Aug 24 03:44:17.435611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca607699-2a23-4d4a-bd8e-019b6e510cb4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:17.447362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 733/1496] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:44:17.455695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca42d22-3aef-4f59-92b2-5b5c3df43391 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:17.465529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca42d22-3aef-4f59-92b2-5b5c3df43391 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:17.526800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:17.561053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761508b-7aca-4095-ad13-5efce8615c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:17.561857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761508b-7aca-4095-ad13-5efce8615c39 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.562368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761508b-7aca-4095-ad13-5efce8615c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.562950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761508b-7aca-4095-ad13-5efce8615c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.563637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761508b-7aca-4095-ad13-5efce8615c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:17.565386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-c761508b-7aca-4095-ad13-5efce8615c39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:17.565386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Aug 24 03:44:17.565386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: Aug 24 03:44:17.566587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761508b-7aca-4095-ad13-5efce8615c39 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:17.706288 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 764/1497] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:44:17 2022] POST /identity/v3/projects => generated 377 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:17.711420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca607699-2a23-4d4a-bd8e-019b6e510cb4 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:17.712944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ca607699-2a23-4d4a-bd8e-019b6e510cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.747335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca607699-2a23-4d4a-bd8e-019b6e510cb4 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:17.841795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56519223-43fb-43a4-a661-113c8c9682dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:17.842405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56519223-43fb-43a4-a661-113c8c9682dd admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.842685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56519223-43fb-43a4-a661-113c8c9682dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.842956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56519223-43fb-43a4-a661-113c8c9682dd admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.843633 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56519223-43fb-43a4-a661-113c8c9682dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:17.844655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-56519223-43fb-43a4-a661-113c8c9682dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:17.844655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Aug 24 03:44:17.844655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: Aug 24 03:44:17.845869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56519223-43fb-43a4-a661-113c8c9682dd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:17.929600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 734/1498] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:44:17 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:44:17.933799 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761508b-7aca-4095-ad13-5efce8615c39 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:17.935360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c761508b-7aca-4095-ad13-5efce8615c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.998022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761508b-7aca-4095-ad13-5efce8615c39 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.080067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:18.091058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b05e7-0050-4872-a51b-01cfa7a04f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.094511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b05e7-0050-4872-a51b-01cfa7a04f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.094511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b05e7-0050-4872-a51b-01cfa7a04f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.094511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b05e7-0050-4872-a51b-01cfa7a04f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.094511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b05e7-0050-4872-a51b-01cfa7a04f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.094511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-7e4b05e7-0050-4872-a51b-01cfa7a04f49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:18.094511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Aug 24 03:44:18.094511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: Aug 24 03:44:18.095146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b05e7-0050-4872-a51b-01cfa7a04f49 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.107651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 765/1499] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:18.111529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56519223-43fb-43a4-a661-113c8c9682dd admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:18.113039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-56519223-43fb-43a4-a661-113c8c9682dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:18.125015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56519223-43fb-43a4-a661-113c8c9682dd admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.149976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:18.222971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938940ec-6a6c-4a1a-b8ba-1fdb90e7bd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.223635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938940ec-6a6c-4a1a-b8ba-1fdb90e7bd88 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.223909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938940ec-6a6c-4a1a-b8ba-1fdb90e7bd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.224836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938940ec-6a6c-4a1a-b8ba-1fdb90e7bd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.225488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938940ec-6a6c-4a1a-b8ba-1fdb90e7bd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.226545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-938940ec-6a6c-4a1a-b8ba-1fdb90e7bd88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:18.226545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Aug 24 03:44:18.226545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: Aug 24 03:44:18.227482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938940ec-6a6c-4a1a-b8ba-1fdb90e7bd88 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.240614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 735/1500] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:44:18.244953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b05e7-0050-4872-a51b-01cfa7a04f49 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:18.246601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7e4b05e7-0050-4872-a51b-01cfa7a04f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:18.281669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b05e7-0050-4872-a51b-01cfa7a04f49 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.386624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc7355-177f-490a-a87e-1840dabf0bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.387843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc7355-177f-490a-a87e-1840dabf0bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.388331 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc7355-177f-490a-a87e-1840dabf0bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.388724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc7355-177f-490a-a87e-1840dabf0bf1 admin admin] PATH_INFO: `/v3/projects/2453707ca7ca4696a51da749be621a3a/users/2554c9aec34c495caeb73e901d3935d3/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.412414 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc7355-177f-490a-a87e-1840dabf0bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2453707ca7ca4696a51da749be621a3a, user_id=2554c9aec34c495caeb73e901d3935d3, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.413529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-3ecc7355-177f-490a-a87e-1840dabf0bf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:18.413529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Aug 24 03:44:18.413529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: Aug 24 03:44:18.415622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc7355-177f-490a-a87e-1840dabf0bf1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.568523 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 766/1501] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:44:18 2022] PUT /identity/v3/projects/2453707ca7ca4696a51da749be621a3a/users/2554c9aec34c495caeb73e901d3935d3/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:18.580751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e1924-290d-438e-a792-6270fb4a3682 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.581075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e1924-290d-438e-a792-6270fb4a3682 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.581358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e1924-290d-438e-a792-6270fb4a3682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.638522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-633e1924-290d-438e-a792-6270fb4a3682 None None] MFA Rules not processed for user `2554c9aec34c495caeb73e901d3935d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:18.639784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-633e1924-290d-438e-a792-6270fb4a3682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:18.720420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 736/1502] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:18.733474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac16547-4e12-4ca6-942d-020b15491bac None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.733769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac16547-4e12-4ca6-942d-020b15491bac None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.734049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac16547-4e12-4ca6-942d-020b15491bac None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.735427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 767/1503] 10.222.0.88 () {54 vars in 964 bytes} [Wed Aug 24 03:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:44:18.740353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25679-1ae3-448d-b9f1-a9b9d05969d3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.740680 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25679-1ae3-448d-b9f1-a9b9d05969d3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.741045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25679-1ae3-448d-b9f1-a9b9d05969d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.773438 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:18.816770 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0ef25679-1ae3-448d-b9f1-a9b9d05969d3 None None] MFA Rules not processed for user `380240bcfca240a2b4969f6618409a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:18.819322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0ef25679-1ae3-448d-b9f1-a9b9d05969d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:18.895558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 737/1504] 10.222.0.88 () {58 vars in 1061 bytes} [Wed Aug 24 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:18.904090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac16547-4e12-4ca6-942d-020b15491bac None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:18.905688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ac16547-4e12-4ca6-942d-020b15491bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:18.958275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:19.019391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac16547-4e12-4ca6-942d-020b15491bac None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.093444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34cb3e-3701-4490-9682-8c667be5418b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.093991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34cb3e-3701-4490-9682-8c667be5418b service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.094272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34cb3e-3701-4490-9682-8c667be5418b service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.094545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34cb3e-3701-4490-9682-8c667be5418b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.096209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ca34cb3e-3701-4490-9682-8c667be5418b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:19.194952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34cb3e-3701-4490-9682-8c667be5418b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:19.196431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34cb3e-3701-4490-9682-8c667be5418b service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:19.200087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:19.216352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 768/1505] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:19.261528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4a5d-ad07-4041-9240-117659a2cd3f None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.261993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4a5d-ad07-4041-9240-117659a2cd3f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.262094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d4a5d-ad07-4041-9240-117659a2cd3f None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.263439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 738/1506] 10.222.0.88 () {52 vars in 830 bytes} [Wed Aug 24 03:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:44:19.267180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34cb3e-3701-4490-9682-8c667be5418b service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:19.268406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ca34cb3e-3701-4490-9682-8c667be5418b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:19.372826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34cb3e-3701-4490-9682-8c667be5418b service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:19.467225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:19.467861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.468289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.468572 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] PATH_INFO: `/v3/users/2554c9aec34c495caeb73e901d3935d3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.481206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2554c9aec34c495caeb73e901d3935d3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:19.482371 dv-cinder-854262-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:19.482371 dv-cinder-854262-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Aug 24 03:44:19.482371 dv-cinder-854262-1-smb devstack@keystone.service[81854]: Aug 24 03:44:19.483618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:19.493900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:19.730835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2554c9aec34c495caeb73e901d3935d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.731437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2554c9aec34c495caeb73e901d3935d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.731879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2554c9aec34c495caeb73e901d3935d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.800774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2554c9aec34c495caeb73e901d3935d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.823863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2554c9aec34c495caeb73e901d3935d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:19.843905 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 769/1507] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:44:19 2022] DELETE /identity/v3/users/2554c9aec34c495caeb73e901d3935d3 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:19.848450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907980-400b-441a-8305-84a7b0bc7b3f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:19.848732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907980-400b-441a-8305-84a7b0bc7b3f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:19.849002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907980-400b-441a-8305-84a7b0bc7b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:19.906244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-cc907980-400b-441a-8305-84a7b0bc7b3f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:19.907491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cc907980-400b-441a-8305-84a7b0bc7b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:19.984095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:19.997146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 739/1508] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:20.007310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:20.008551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:20.107557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb6777-f6cd-4412-a5a5-3ea6b959a503 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:20.162498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:20.181467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5b1f-415f-4c18-a5d3-d1491db58a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:20.182077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5b1f-415f-4c18-a5d3-d1491db58a64 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:20.182358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5b1f-415f-4c18-a5d3-d1491db58a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:20.182636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5b1f-415f-4c18-a5d3-d1491db58a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:20.184272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-610e5b1f-415f-4c18-a5d3-d1491db58a64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:20.296694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5b1f-415f-4c18-a5d3-d1491db58a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:20.298070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5b1f-415f-4c18-a5d3-d1491db58a64 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:20.317112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 770/1509] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:20.734313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907980-400b-441a-8305-84a7b0bc7b3f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:20.735590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cc907980-400b-441a-8305-84a7b0bc7b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:20.747925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907980-400b-441a-8305-84a7b0bc7b3f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:20.851183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:20.851753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:20.852036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:20.852313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] PATH_INFO: `/v3/projects/2453707ca7ca4696a51da749be621a3a` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:20.862540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2453707ca7ca4696a51da749be621a3a)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:20.863613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:20.863613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Aug 24 03:44:20.863613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: Aug 24 03:44:20.865418 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:20.983835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2453707ca7ca4696a51da749be621a3a', 'request_id': 'req-ccc3e74d-f617-421b-b425-c29989fa4e4b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:20.989767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2453707ca7ca4696a51da749be621a3a', 'request_id': 'req-ccc3e74d-f617-421b-b425-c29989fa4e4b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:21.041319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2453707ca7ca4696a51da749be621a3a', 'request_id': 'req-ccc3e74d-f617-421b-b425-c29989fa4e4b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:21.072840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] The token cache is being invalidate because project 2453707ca7ca4696a51da749be621a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:21.073133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:21.073562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ccc3e74d-f617-421b-b425-c29989fa4e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:21.074969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 740/1510] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:20 2022] DELETE /identity/v3/projects/2453707ca7ca4696a51da749be621a3a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:30.314758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=62 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:31.070675 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:02.510154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59281-6ac8-49ea-9d96-3b3179de103a None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:02.510765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59281-6ac8-49ea-9d96-3b3179de103a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:02.510765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59281-6ac8-49ea-9d96-3b3179de103a None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:02.512181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 771/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:02.517115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a368f-5ffb-4750-b12b-f6f2f0ab527d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:02.517582 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a368f-5ffb-4750-b12b-f6f2f0ab527d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:02.517687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a368f-5ffb-4750-b12b-f6f2f0ab527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:02.599334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-999a368f-5ffb-4750-b12b-f6f2f0ab527d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:02.600516 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-999a368f-5ffb-4750-b12b-f6f2f0ab527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:02.705437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 741/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:02.861084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed59281-6ac8-49ea-9d96-3b3179de103a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:02.865083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ed59281-6ac8-49ea-9d96-3b3179de103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:02.986866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed59281-6ac8-49ea-9d96-3b3179de103a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:02.992864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ac84e-dd0e-4579-b202-a7df04202f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:02.993472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ac84e-dd0e-4579-b202-a7df04202f7d service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:02.993753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ac84e-dd0e-4579-b202-a7df04202f7d service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:02.994023 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ac84e-dd0e-4579-b202-a7df04202f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:03.001976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ac84e-dd0e-4579-b202-a7df04202f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:03.003608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ac84e-dd0e-4579-b202-a7df04202f7d service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:03.013526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 772/1513] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:03.856618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554a2d9-5257-4d6b-9010-3b6125134d40 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:03.857184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554a2d9-5257-4d6b-9010-3b6125134d40 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:03.857184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554a2d9-5257-4d6b-9010-3b6125134d40 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:03.858540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 742/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:03.863364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98c3d8-d373-48c8-b88a-6db49a3602ea None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:03.863815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98c3d8-d373-48c8-b88a-6db49a3602ea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:03.863912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98c3d8-d373-48c8-b88a-6db49a3602ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:03.884406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-df98c3d8-d373-48c8-b88a-6db49a3602ea None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:03.885615 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-df98c3d8-d373-48c8-b88a-6db49a3602ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:03.893556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 773/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:04.044099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554a2d9-5257-4d6b-9010-3b6125134d40 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:04.059129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554a2d9-5257-4d6b-9010-3b6125134d40 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:04.064584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5701d-6274-46de-8030-6ad49a20c4d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:04.065186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5701d-6274-46de-8030-6ad49a20c4d7 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:04.065475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5701d-6274-46de-8030-6ad49a20c4d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:04.065770 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5701d-6274-46de-8030-6ad49a20c4d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:04.073855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5701d-6274-46de-8030-6ad49a20c4d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:04.075497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5701d-6274-46de-8030-6ad49a20c4d7 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:04.085007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 743/1516] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:04.470626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4856-022c-4d2b-834a-2a2f483772a8 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:04.470938 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4856-022c-4d2b-834a-2a2f483772a8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:04.471252 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4856-022c-4d2b-834a-2a2f483772a8 None None] PATH_INFO: `/v3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:04.472573 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 774/1517] 10.222.0.93 () {54 vars in 925 bytes} [Wed Aug 24 03:46:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:04.479668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef0142-fa2b-470f-bf8d-23c846872459 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:04.479962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef0142-fa2b-470f-bf8d-23c846872459 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:04.480243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef0142-fa2b-470f-bf8d-23c846872459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:04.539505 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ceef0142-fa2b-470f-bf8d-23c846872459 None None] MFA Rules not processed for user `e686e974721345eba4de46cde2edaf34`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:04.540732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ceef0142-fa2b-470f-bf8d-23c846872459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:04.557470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:04.615536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 744/1518] 10.222.0.93 () {58 vars in 1015 bytes} [Wed Aug 24 03:46:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:46:13.825460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643833-cd76-4e71-98c7-cb7d548d0805 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:13.825992 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643833-cd76-4e71-98c7-cb7d548d0805 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:13.825992 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643833-cd76-4e71-98c7-cb7d548d0805 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:13.827304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 775/1519] 10.222.0.88 () {54 vars in 961 bytes} [Wed Aug 24 03:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:13.832873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66625516-12d0-471c-bc40-d1cc46db2ba0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:13.832873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66625516-12d0-471c-bc40-d1cc46db2ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:13.833414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66625516-12d0-471c-bc40-d1cc46db2ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:13.854966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-66625516-12d0-471c-bc40-d1cc46db2ba0 None None] MFA Rules not processed for user `e686e974721345eba4de46cde2edaf34`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:13.856248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-66625516-12d0-471c-bc40-d1cc46db2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:13.865472 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 745/1520] 10.222.0.88 () {58 vars in 1058 bytes} [Wed Aug 24 03:46:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:13.873374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14643833-cd76-4e71-98c7-cb7d548d0805 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:13.887558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14643833-cd76-4e71-98c7-cb7d548d0805 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:13.892525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccdc4f-5786-44ec-914c-04fbdc0248c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:13.893143 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccdc4f-5786-44ec-914c-04fbdc0248c8 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:13.893425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccdc4f-5786-44ec-914c-04fbdc0248c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:13.893700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccdc4f-5786-44ec-914c-04fbdc0248c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:13.902555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccdc4f-5786-44ec-914c-04fbdc0248c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:13.904183 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccdc4f-5786-44ec-914c-04fbdc0248c8 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:13.913766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 776/1521] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:15.322871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9296cbf-e0d5-4f46-af6f-4b915c8a076e None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:15.323435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9296cbf-e0d5-4f46-af6f-4b915c8a076e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:15.323435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9296cbf-e0d5-4f46-af6f-4b915c8a076e None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:15.324812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 746/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:15.329760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca735b22-9e79-43ca-ad81-0951071deafb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:15.333918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca735b22-9e79-43ca-ad81-0951071deafb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:15.333918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca735b22-9e79-43ca-ad81-0951071deafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:15.350318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ca735b22-9e79-43ca-ad81-0951071deafb None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:15.351574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ca735b22-9e79-43ca-ad81-0951071deafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:15.359470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 777/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:15.513184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9296cbf-e0d5-4f46-af6f-4b915c8a076e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:15.527408 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9296cbf-e0d5-4f46-af6f-4b915c8a076e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:15.532814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f9c74-db16-4012-9374-8f1149b540a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:15.533401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9c74-db16-4012-9374-8f1149b540a9 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:15.533679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9c74-db16-4012-9374-8f1149b540a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:15.533948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9c74-db16-4012-9374-8f1149b540a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:15.542009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f9c74-db16-4012-9374-8f1149b540a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:15.543655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f9c74-db16-4012-9374-8f1149b540a9 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:15.552889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 747/1524] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:16.375118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653951c-c675-4322-bf97-5dd87bd55702 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:16.375696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653951c-c675-4322-bf97-5dd87bd55702 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:16.375696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653951c-c675-4322-bf97-5dd87bd55702 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:16.377041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 778/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:16.382877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7a2c-fb8e-4007-a10c-88acfde45f4e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:16.383365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7a2c-fb8e-4007-a10c-88acfde45f4e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:16.383732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7a2c-fb8e-4007-a10c-88acfde45f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:16.402828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-461d7a2c-fb8e-4007-a10c-88acfde45f4e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:16.404066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-461d7a2c-fb8e-4007-a10c-88acfde45f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:16.411975 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 748/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:46:16.563567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653951c-c675-4322-bf97-5dd87bd55702 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:16.578266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653951c-c675-4322-bf97-5dd87bd55702 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:16.583675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1bf20-c32b-416b-8a66-ba428a6990fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:16.584406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1bf20-c32b-416b-8a66-ba428a6990fd service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:16.584688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1bf20-c32b-416b-8a66-ba428a6990fd service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:16.584958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1bf20-c32b-416b-8a66-ba428a6990fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:16.593241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1bf20-c32b-416b-8a66-ba428a6990fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:16.594817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1bf20-c32b-416b-8a66-ba428a6990fd service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:16.604310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 779/1527] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:20.491427 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323a578-3a18-4f33-bdab-2e7ee0420b84 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:20.491969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323a578-3a18-4f33-bdab-2e7ee0420b84 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:20.492064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323a578-3a18-4f33-bdab-2e7ee0420b84 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:20.493399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 749/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:20.498912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072d31-5d0a-4af8-849d-119bd2c55054 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:20.499380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072d31-5d0a-4af8-849d-119bd2c55054 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:20.499489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072d31-5d0a-4af8-849d-119bd2c55054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:20.519188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-aa072d31-5d0a-4af8-849d-119bd2c55054 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:20.520386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aa072d31-5d0a-4af8-849d-119bd2c55054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:20.528802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 780/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:20.822980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323a578-3a18-4f33-bdab-2e7ee0420b84 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:20.824775 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3323a578-3a18-4f33-bdab-2e7ee0420b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:20.903982 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323a578-3a18-4f33-bdab-2e7ee0420b84 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:20.907528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f0096-6c4b-4579-9bb7-72a3b9811222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:20.908130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f0096-6c4b-4579-9bb7-72a3b9811222 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:20.908408 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f0096-6c4b-4579-9bb7-72a3b9811222 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:20.908679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f0096-6c4b-4579-9bb7-72a3b9811222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:20.917540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f0096-6c4b-4579-9bb7-72a3b9811222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:20.918974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f0096-6c4b-4579-9bb7-72a3b9811222 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:20.928686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 750/1530] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:22.817413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a163-d750-43ca-bc53-925267ff696a None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.818041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a163-d750-43ca-bc53-925267ff696a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.818041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a163-d750-43ca-bc53-925267ff696a None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.819808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 781/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:22.828497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834c5e-0e0b-497a-982d-372b01448d57 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.829010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834c5e-0e0b-497a-982d-372b01448d57 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.829152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834c5e-0e0b-497a-982d-372b01448d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.848658 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-53834c5e-0e0b-497a-982d-372b01448d57 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:22.850390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-53834c5e-0e0b-497a-982d-372b01448d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:22.858193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 751/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.140093 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54a163-d750-43ca-bc53-925267ff696a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.151325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54a163-d750-43ca-bc53-925267ff696a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.154806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75365e3b-11f8-4c93-8339-bb80d8bf0445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.155447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365e3b-11f8-4c93-8339-bb80d8bf0445 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.155730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365e3b-11f8-4c93-8339-bb80d8bf0445 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.156005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365e3b-11f8-4c93-8339-bb80d8bf0445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.165365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75365e3b-11f8-4c93-8339-bb80d8bf0445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.166797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75365e3b-11f8-4c93-8339-bb80d8bf0445 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.176196 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 782/1533] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:27.088638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba755f3b-172e-49ed-8c7a-bd566e6bee0d None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.089211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba755f3b-172e-49ed-8c7a-bd566e6bee0d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.089211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba755f3b-172e-49ed-8c7a-bd566e6bee0d None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.090597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 752/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:27.096036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a10b6-139e-4454-90c3-3e0f119cb993 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.096463 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a10b6-139e-4454-90c3-3e0f119cb993 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.096593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a10b6-139e-4454-90c3-3e0f119cb993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.116300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-891a10b6-139e-4454-90c3-3e0f119cb993 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:27.118922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-891a10b6-139e-4454-90c3-3e0f119cb993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:27.125533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 783/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:27.672154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba755f3b-172e-49ed-8c7a-bd566e6bee0d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:27.673805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ba755f3b-172e-49ed-8c7a-bd566e6bee0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:27.738836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:27.752199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba755f3b-172e-49ed-8c7a-bd566e6bee0d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:27.758081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c193f-c5ae-4f26-908a-49c6cb2ab085 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:27.758081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c193f-c5ae-4f26-908a-49c6cb2ab085 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.758081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c193f-c5ae-4f26-908a-49c6cb2ab085 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.758081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c193f-c5ae-4f26-908a-49c6cb2ab085 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.766599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c193f-c5ae-4f26-908a-49c6cb2ab085 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:27.768149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c193f-c5ae-4f26-908a-49c6cb2ab085 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:27.785460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 753/1536] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:29.777817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffd3ed-3a88-43be-980e-1894d98e4c88 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:29.778424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffd3ed-3a88-43be-980e-1894d98e4c88 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:29.778424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffd3ed-3a88-43be-980e-1894d98e4c88 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:29.779829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 784/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:29.785232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041dead-87d3-4926-b83b-07397e375122 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:29.785664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041dead-87d3-4926-b83b-07397e375122 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:29.785772 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041dead-87d3-4926-b83b-07397e375122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:29.805553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8041dead-87d3-4926-b83b-07397e375122 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:29.806762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8041dead-87d3-4926-b83b-07397e375122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:29.814649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 754/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:30.381754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffd3ed-3a88-43be-980e-1894d98e4c88 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:30.383454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f7ffd3ed-3a88-43be-980e-1894d98e4c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:30.390965 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:30.396761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffd3ed-3a88-43be-980e-1894d98e4c88 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:30.400379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48041560-e621-41ac-ae4a-539e63e10c9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:30.405471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48041560-e621-41ac-ae4a-539e63e10c9e service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:30.405471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48041560-e621-41ac-ae4a-539e63e10c9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:30.405471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48041560-e621-41ac-ae4a-539e63e10c9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:30.410515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48041560-e621-41ac-ae4a-539e63e10c9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:30.412518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48041560-e621-41ac-ae4a-539e63e10c9e service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:30.421951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 785/1539] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:39.800899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=11 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:40.437406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:58.857608 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5efc7-3492-4ecc-a2a9-d529bfd28eff None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:58.860216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5efc7-3492-4ecc-a2a9-d529bfd28eff None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:58.860216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5efc7-3492-4ecc-a2a9-d529bfd28eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:58.892840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a5b5efc7-3492-4ecc-a2a9-d529bfd28eff None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:58.895184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a5b5efc7-3492-4ecc-a2a9-d529bfd28eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:58.907787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 755/1540] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:58.916911 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d9ce-4dd6-47b5-a385-cd4d3296ffbb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:58.917535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d9ce-4dd6-47b5-a385-cd4d3296ffbb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:58.917535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d9ce-4dd6-47b5-a385-cd4d3296ffbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:58.948372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-98e1d9ce-4dd6-47b5-a385-cd4d3296ffbb None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:58.950039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-98e1d9ce-4dd6-47b5-a385-cd4d3296ffbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:58.952154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ced5-5a47-48a8-945b-28d0548434a9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:58.952443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ced5-5a47-48a8-945b-28d0548434a9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:58.952750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ced5-5a47-48a8-945b-28d0548434a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:58.982657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 786/1541] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:58.989416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1d9ce-4dd6-47b5-a385-cd4d3296ffbb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:58.995334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-cb06ced5-5a47-48a8-945b-28d0548434a9 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:58.996951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cb06ced5-5a47-48a8-945b-28d0548434a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.005856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1d9ce-4dd6-47b5-a385-cd4d3296ffbb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.016759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da94ec-4547-4382-ac17-1f9d3acdfe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.017475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da94ec-4547-4382-ac17-1f9d3acdfe40 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.017753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da94ec-4547-4382-ac17-1f9d3acdfe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.018030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da94ec-4547-4382-ac17-1f9d3acdfe40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.018705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da94ec-4547-4382-ac17-1f9d3acdfe40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:59.019012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da94ec-4547-4382-ac17-1f9d3acdfe40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.020105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-e9da94ec-4547-4382-ac17-1f9d3acdfe40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:47:59.020105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Aug 24 03:47:59.020105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: Aug 24 03:47:59.021008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da94ec-4547-4382-ac17-1f9d3acdfe40 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:59.021943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 756/1542] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:59.027266 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6515c-e397-4833-92e1-9a3bcc2e9eac None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.027879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6515c-e397-4833-92e1-9a3bcc2e9eac None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.027879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6515c-e397-4833-92e1-9a3bcc2e9eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.060108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 787/1543] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:59.067846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da94ec-4547-4382-ac17-1f9d3acdfe40 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.069353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-81f6515c-e397-4833-92e1-9a3bcc2e9eac None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.070614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-81f6515c-e397-4833-92e1-9a3bcc2e9eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.089402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da94ec-4547-4382-ac17-1f9d3acdfe40 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.096234 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 757/1544] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:59.098087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20072eb8-1d34-4d70-9f3a-50160cf3975c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.098377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20072eb8-1d34-4d70-9f3a-50160cf3975c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.098655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20072eb8-1d34-4d70-9f3a-50160cf3975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.103689 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa163b55-9f4d-40e1-843a-d393d374e034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.104426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa163b55-9f4d-40e1-843a-d393d374e034 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.104711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa163b55-9f4d-40e1-843a-d393d374e034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.105040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa163b55-9f4d-40e1-843a-d393d374e034 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.106125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa163b55-9f4d-40e1-843a-d393d374e034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.108599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa163b55-9f4d-40e1-843a-d393d374e034 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:59.148677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-20072eb8-1d34-4d70-9f3a-50160cf3975c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.151748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-20072eb8-1d34-4d70-9f3a-50160cf3975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.174275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 758/1545] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.179440 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20072eb8-1d34-4d70-9f3a-50160cf3975c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.194197 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20072eb8-1d34-4d70-9f3a-50160cf3975c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.200540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea067f-183c-4122-9f88-3723dd257082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.201415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea067f-183c-4122-9f88-3723dd257082 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.201704 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea067f-183c-4122-9f88-3723dd257082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.201982 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea067f-183c-4122-9f88-3723dd257082 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.202699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea067f-183c-4122-9f88-3723dd257082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:59.203011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea067f-183c-4122-9f88-3723dd257082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.204806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea067f-183c-4122-9f88-3723dd257082 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:59.222472 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 759/1546] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:59.223979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb900f-828a-4e9d-a6ae-5dce75198369 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.224374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb900f-828a-4e9d-a6ae-5dce75198369 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.224658 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb900f-828a-4e9d-a6ae-5dce75198369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.247313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4dfb900f-828a-4e9d-a6ae-5dce75198369 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.248541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4dfb900f-828a-4e9d-a6ae-5dce75198369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.257634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 760/1547] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.258681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5d19-7ea7-4b4e-8a03-7af750170ccd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.258972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5d19-7ea7-4b4e-8a03-7af750170ccd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.259471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5d19-7ea7-4b4e-8a03-7af750170ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.273725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 788/1548] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/projects => generated 355 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:59.277619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb97ec-2e81-46a2-ba55-a2a30035c234 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.278190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb97ec-2e81-46a2-ba55-a2a30035c234 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.278694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb97ec-2e81-46a2-ba55-a2a30035c234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.279930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4e7e5d19-7ea7-4b4e-8a03-7af750170ccd None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.281153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4e7e5d19-7ea7-4b4e-8a03-7af750170ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.316133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bbeb97ec-2e81-46a2-ba55-a2a30035c234 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.317453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bbeb97ec-2e81-46a2-ba55-a2a30035c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.362488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 761/1549] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.363797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe871a-c4d1-40e5-84d3-8af2cb39c172 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.364087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe871a-c4d1-40e5-84d3-8af2cb39c172 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.364366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe871a-c4d1-40e5-84d3-8af2cb39c172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.384498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a3fe871a-c4d1-40e5-84d3-8af2cb39c172 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.386158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a3fe871a-c4d1-40e5-84d3-8af2cb39c172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.394252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 762/1550] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.395139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe871a-c4d1-40e5-84d3-8af2cb39c172 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.396770 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 789/1551] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.398535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee04f6d-e935-4e6e-9bcb-e9166352e4c6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.398824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee04f6d-e935-4e6e-9bcb-e9166352e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.402967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee04f6d-e935-4e6e-9bcb-e9166352e4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.408021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe871a-c4d1-40e5-84d3-8af2cb39c172 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.413858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83339b43-e170-4452-ad8e-d20f9346f5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.414496 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339b43-e170-4452-ad8e-d20f9346f5cb admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.414780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339b43-e170-4452-ad8e-d20f9346f5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.415072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339b43-e170-4452-ad8e-d20f9346f5cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.415705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83339b43-e170-4452-ad8e-d20f9346f5cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.416725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-83339b43-e170-4452-ad8e-d20f9346f5cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:47:59.416725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Aug 24 03:47:59.416725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: Aug 24 03:47:59.417916 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83339b43-e170-4452-ad8e-d20f9346f5cb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:59.418801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cee04f6d-e935-4e6e-9bcb-e9166352e4c6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.420059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cee04f6d-e935-4e6e-9bcb-e9166352e4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.429404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 790/1552] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.430282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee04f6d-e935-4e6e-9bcb-e9166352e4c6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.439761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee04f6d-e935-4e6e-9bcb-e9166352e4c6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.445290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b2cc4-2aba-4c39-bfe7-cf0e07b4089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.449766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2cc4-2aba-4c39-bfe7-cf0e07b4089f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.449766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2cc4-2aba-4c39-bfe7-cf0e07b4089f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.449766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2cc4-2aba-4c39-bfe7-cf0e07b4089f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.449766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b2cc4-2aba-4c39-bfe7-cf0e07b4089f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.449766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-038b2cc4-2aba-4c39-bfe7-cf0e07b4089f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:47:59.449766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Aug 24 03:47:59.449766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: Aug 24 03:47:59.450406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b2cc4-2aba-4c39-bfe7-cf0e07b4089f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:59.553849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 763/1553] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:59.554528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a41f0-679b-47eb-87e5-84dfd3125da3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.554842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a41f0-679b-47eb-87e5-84dfd3125da3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.555141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a41f0-679b-47eb-87e5-84dfd3125da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.573951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6c6a41f0-679b-47eb-87e5-84dfd3125da3 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.575183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6c6a41f0-679b-47eb-87e5-84dfd3125da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.582097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 791/1554] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/users => generated 278 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:59.582097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ec2d-ee70-4cb4-b4dd-51371bb4b413 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.582097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ec2d-ee70-4cb4-b4dd-51371bb4b413 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.582097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ec2d-ee70-4cb4-b4dd-51371bb4b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.601375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2199ec2d-ee70-4cb4-b4dd-51371bb4b413 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.602594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2199ec2d-ee70-4cb4-b4dd-51371bb4b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.646069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 764/1555] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.647511 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358d02-fd60-4bf7-9506-d4fbfbee996e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.647803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358d02-fd60-4bf7-9506-d4fbfbee996e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.648079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358d02-fd60-4bf7-9506-d4fbfbee996e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.668392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-79358d02-fd60-4bf7-9506-d4fbfbee996e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.669666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-79358d02-fd60-4bf7-9506-d4fbfbee996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.675536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 792/1556] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.677754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 765/1557] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.679171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358d02-fd60-4bf7-9506-d4fbfbee996e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.680864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751a89-0890-4148-b6a0-86ad49e741ee None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.681390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751a89-0890-4148-b6a0-86ad49e741ee None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.681928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751a89-0890-4148-b6a0-86ad49e741ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.688943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358d02-fd60-4bf7-9506-d4fbfbee996e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.693939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5b58c-b5bc-4ed7-a583-538fede28bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.694543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5b58c-b5bc-4ed7-a583-538fede28bae admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.694827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5b58c-b5bc-4ed7-a583-538fede28bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.695130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5b58c-b5bc-4ed7-a583-538fede28bae admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.695789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5b58c-b5bc-4ed7-a583-538fede28bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:59.696105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5b58c-b5bc-4ed7-a583-538fede28bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.697721 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5b58c-b5bc-4ed7-a583-538fede28bae admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:59.703137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-62751a89-0890-4148-b6a0-86ad49e741ee None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.718880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-62751a89-0890-4148-b6a0-86ad49e741ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.719011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 766/1558] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:59.719011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5b58c-b5bc-4ed7-a583-538fede28bae admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.719254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 793/1559] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.719254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62751a89-0890-4148-b6a0-86ad49e741ee None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.723533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62751a89-0890-4148-b6a0-86ad49e741ee None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.725571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5b58c-b5bc-4ed7-a583-538fede28bae admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.729209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805541ca-99e2-441f-a5cf-46b300862b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.729858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805541ca-99e2-441f-a5cf-46b300862b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.730087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805541ca-99e2-441f-a5cf-46b300862b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.730362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805541ca-99e2-441f-a5cf-46b300862b99 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.730488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65204275-2fa0-4129-9687-6512aae83351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.730999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65204275-2fa0-4129-9687-6512aae83351 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.731174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805541ca-99e2-441f-a5cf-46b300862b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.731409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65204275-2fa0-4129-9687-6512aae83351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.731673 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65204275-2fa0-4129-9687-6512aae83351 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.732354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65204275-2fa0-4129-9687-6512aae83351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:59.732660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65204275-2fa0-4129-9687-6512aae83351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.733030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805541ca-99e2-441f-a5cf-46b300862b99 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:59.734251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65204275-2fa0-4129-9687-6512aae83351 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:59.736045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:59.748028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 767/1560] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:59.748876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65204275-2fa0-4129-9687-6512aae83351 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.758505 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65204275-2fa0-4129-9687-6512aae83351 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.763220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda064f3-b8e7-431f-9a9d-ad5cbc8779ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.763803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda064f3-b8e7-431f-9a9d-ad5cbc8779ce admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.764087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda064f3-b8e7-431f-9a9d-ad5cbc8779ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.764364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda064f3-b8e7-431f-9a9d-ad5cbc8779ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.765002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda064f3-b8e7-431f-9a9d-ad5cbc8779ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.766709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda064f3-b8e7-431f-9a9d-ad5cbc8779ce admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:59.777199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 768/1561] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:59.780706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36030f92-f5d4-4683-8d19-c99e4cac12c8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.780706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36030f92-f5d4-4683-8d19-c99e4cac12c8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.780706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36030f92-f5d4-4683-8d19-c99e4cac12c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.797884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-36030f92-f5d4-4683-8d19-c99e4cac12c8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.799152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-36030f92-f5d4-4683-8d19-c99e4cac12c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.807914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 769/1562] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.808754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36030f92-f5d4-4683-8d19-c99e4cac12c8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.817819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36030f92-f5d4-4683-8d19-c99e4cac12c8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.822355 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54dac72-8c72-49fe-bc06-452fd9215c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.822914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dac72-8c72-49fe-bc06-452fd9215c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.823226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dac72-8c72-49fe-bc06-452fd9215c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.823501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dac72-8c72-49fe-bc06-452fd9215c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.824161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54dac72-8c72-49fe-bc06-452fd9215c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:59.824464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54dac72-8c72-49fe-bc06-452fd9215c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.826041 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54dac72-8c72-49fe-bc06-452fd9215c26 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:59.838440 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 770/1563] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:59.845896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3f080-1f2c-40a2-aa72-250763f962fa None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.845896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3f080-1f2c-40a2-aa72-250763f962fa None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.845896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3f080-1f2c-40a2-aa72-250763f962fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.860486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a3f3f080-1f2c-40a2-aa72-250763f962fa None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:59.861705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a3f3f080-1f2c-40a2-aa72-250763f962fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.873761 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 771/1564] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:59.878037 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3f080-1f2c-40a2-aa72-250763f962fa None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.884414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3f080-1f2c-40a2-aa72-250763f962fa None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.889039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95e7f8-f135-4f7f-b670-fc38683947d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.889626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e7f8-f135-4f7f-b670-fc38683947d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.889906 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e7f8-f135-4f7f-b670-fc38683947d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.890187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95e7f8-f135-4f7f-b670-fc38683947d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.890809 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95e7f8-f135-4f7f-b670-fc38683947d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.892761 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95e7f8-f135-4f7f-b670-fc38683947d7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.020984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 772/1565] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:00.022466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95e7f8-f135-4f7f-b670-fc38683947d7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.084174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95e7f8-f135-4f7f-b670-fc38683947d7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.089528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb1391-1de9-45d1-a824-965f60bcf284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.094613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb1391-1de9-45d1-a824-965f60bcf284 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.094613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb1391-1de9-45d1-a824-965f60bcf284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.094613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb1391-1de9-45d1-a824-965f60bcf284 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.094613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb1391-1de9-45d1-a824-965f60bcf284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:00.094613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb1391-1de9-45d1-a824-965f60bcf284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.094613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb1391-1de9-45d1-a824-965f60bcf284 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.105932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 773/1566] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:00.106836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb1391-1de9-45d1-a824-965f60bcf284 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.116980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb1391-1de9-45d1-a824-965f60bcf284 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.121831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec108c-82f9-413c-8436-c30e747d7fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.125953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec108c-82f9-413c-8436-c30e747d7fec admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.125953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec108c-82f9-413c-8436-c30e747d7fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.125953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec108c-82f9-413c-8436-c30e747d7fec admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.125953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec108c-82f9-413c-8436-c30e747d7fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.125953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec108c-82f9-413c-8436-c30e747d7fec admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.255318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 794/1567] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:59 2022] POST /identity/v3/users => generated 286 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:00.255318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805541ca-99e2-441f-a5cf-46b300862b99 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.259391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 774/1568] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:00 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:00.259391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec108c-82f9-413c-8436-c30e747d7fec admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.263633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:00.266388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805541ca-99e2-441f-a5cf-46b300862b99 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.323392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec108c-82f9-413c-8436-c30e747d7fec admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.325406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8df241-7fb6-45f0-9cfd-28a3746da952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.326029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8df241-7fb6-45f0-9cfd-28a3746da952 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.326313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8df241-7fb6-45f0-9cfd-28a3746da952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.326593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8df241-7fb6-45f0-9cfd-28a3746da952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.327892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8df241-7fb6-45f0-9cfd-28a3746da952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.328535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c6fc0-e2cf-47cf-a083-a07203b0988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.329186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c6fc0-e2cf-47cf-a083-a07203b0988f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.329467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c6fc0-e2cf-47cf-a083-a07203b0988f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.329579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8df241-7fb6-45f0-9cfd-28a3746da952 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.329747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c6fc0-e2cf-47cf-a083-a07203b0988f admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.330435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c6fc0-e2cf-47cf-a083-a07203b0988f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:00.330743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c6fc0-e2cf-47cf-a083-a07203b0988f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.332497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c6fc0-e2cf-47cf-a083-a07203b0988f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.340513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 795/1569] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:00.341357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8df241-7fb6-45f0-9cfd-28a3746da952 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.345005 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:00.348992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 775/1570] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:00.348992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c6fc0-e2cf-47cf-a083-a07203b0988f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.361417 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8df241-7fb6-45f0-9cfd-28a3746da952 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.361559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c6fc0-e2cf-47cf-a083-a07203b0988f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.361671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890c31-571d-4081-8423-dc66430c8453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.361671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890c31-571d-4081-8423-dc66430c8453 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.361671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890c31-571d-4081-8423-dc66430c8453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.361671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890c31-571d-4081-8423-dc66430c8453 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.361994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890c31-571d-4081-8423-dc66430c8453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.363528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890c31-571d-4081-8423-dc66430c8453 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.364304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c12a0-e9b1-460c-ba0f-64f0429d8999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.364892 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c12a0-e9b1-460c-ba0f-64f0429d8999 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.365175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c12a0-e9b1-460c-ba0f-64f0429d8999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.365450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c12a0-e9b1-460c-ba0f-64f0429d8999 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.366149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c12a0-e9b1-460c-ba0f-64f0429d8999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:00.366483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c12a0-e9b1-460c-ba0f-64f0429d8999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.368101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c12a0-e9b1-460c-ba0f-64f0429d8999 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.382358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 776/1571] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:00.383215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c12a0-e9b1-460c-ba0f-64f0429d8999 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.392841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c12a0-e9b1-460c-ba0f-64f0429d8999 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.401079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34a1ae-aa17-43ec-a7c7-119ea87641d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.401079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a1ae-aa17-43ec-a7c7-119ea87641d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.401079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a1ae-aa17-43ec-a7c7-119ea87641d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.401079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a1ae-aa17-43ec-a7c7-119ea87641d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.401455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34a1ae-aa17-43ec-a7c7-119ea87641d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.401920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34a1ae-aa17-43ec-a7c7-119ea87641d1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.462713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 796/1572] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:00 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:00.463661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890c31-571d-4081-8423-dc66430c8453 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.475791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 777/1573] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:00 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:00.476991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34a1ae-aa17-43ec-a7c7-119ea87641d1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.486454 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34a1ae-aa17-43ec-a7c7-119ea87641d1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.530446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890c31-571d-4081-8423-dc66430c8453 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.535385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af08b5d-d182-486d-97ac-ffe7a4d2326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.536014 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af08b5d-d182-486d-97ac-ffe7a4d2326f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.536293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af08b5d-d182-486d-97ac-ffe7a4d2326f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.536570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af08b5d-d182-486d-97ac-ffe7a4d2326f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.537272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af08b5d-d182-486d-97ac-ffe7a4d2326f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.539285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af08b5d-d182-486d-97ac-ffe7a4d2326f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.543282 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ce950-87d6-4e04-8ee0-792d02370ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.551555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce950-87d6-4e04-8ee0-792d02370ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.551555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce950-87d6-4e04-8ee0-792d02370ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.551555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ce950-87d6-4e04-8ee0-792d02370ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.551555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ce950-87d6-4e04-8ee0-792d02370ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.551555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ce950-87d6-4e04-8ee0-792d02370ef3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.558700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 778/1574] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:00.562492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ce950-87d6-4e04-8ee0-792d02370ef3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.573124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ce950-87d6-4e04-8ee0-792d02370ef3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.578099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb6d66-5057-4f4c-9537-3999477115e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.578687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb6d66-5057-4f4c-9537-3999477115e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.578971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb6d66-5057-4f4c-9537-3999477115e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.579280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb6d66-5057-4f4c-9537-3999477115e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.579905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb6d66-5057-4f4c-9537-3999477115e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.581822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb6d66-5057-4f4c-9537-3999477115e1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.625818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 797/1575] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:00 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:00.626551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af08b5d-d182-486d-97ac-ffe7a4d2326f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.687458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af08b5d-d182-486d-97ac-ffe7a4d2326f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.692411 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2836b9-e410-407d-a9ef-bd648a8093b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.693228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2836b9-e410-407d-a9ef-bd648a8093b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.697163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2836b9-e410-407d-a9ef-bd648a8093b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.697163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2836b9-e410-407d-a9ef-bd648a8093b4 admin admin] PATH_INFO: `/v3/projects/01b133cc766c42c4bab25a28d94998cd/users/c9ebf7ccd920438586529a86ddbf42eb/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.697346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 779/1576] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:00 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:00.697346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb6d66-5057-4f4c-9537-3999477115e1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.699345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:00.705683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb6d66-5057-4f4c-9537-3999477115e1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.711083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee82342-4064-48d0-bd5a-8f511593e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.711684 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82342-4064-48d0-bd5a-8f511593e85b admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.711970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82342-4064-48d0-bd5a-8f511593e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.712207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2836b9-e410-407d-a9ef-bd648a8093b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b133cc766c42c4bab25a28d94998cd, user_id=c9ebf7ccd920438586529a86ddbf42eb, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.712335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82342-4064-48d0-bd5a-8f511593e85b admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.712870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee82342-4064-48d0-bd5a-8f511593e85b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.714843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee82342-4064-48d0-bd5a-8f511593e85b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.714957 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2836b9-e410-407d-a9ef-bd648a8093b4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.796482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 798/1577] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:00 2022] PUT /identity/v3/projects/01b133cc766c42c4bab25a28d94998cd/users/c9ebf7ccd920438586529a86ddbf42eb/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:00.797378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 780/1578] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:00 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:00.797961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2836b9-e410-407d-a9ef-bd648a8093b4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.798249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee82342-4064-48d0-bd5a-8f511593e85b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.868440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2836b9-e410-407d-a9ef-bd648a8093b4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.871973 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee82342-4064-48d0-bd5a-8f511593e85b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.873189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e0f49-94a7-4991-9b9d-098be8133d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.873807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e0f49-94a7-4991-9b9d-098be8133d79 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.874091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e0f49-94a7-4991-9b9d-098be8133d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.874364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e0f49-94a7-4991-9b9d-098be8133d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.874997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e0f49-94a7-4991-9b9d-098be8133d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.877014 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06cdc-1e58-4aec-b355-e02ca8c8cbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.877140 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e0f49-94a7-4991-9b9d-098be8133d79 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.877710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06cdc-1e58-4aec-b355-e02ca8c8cbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.878066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06cdc-1e58-4aec-b355-e02ca8c8cbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.878414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06cdc-1e58-4aec-b355-e02ca8c8cbb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.879138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d06cdc-1e58-4aec-b355-e02ca8c8cbb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.881126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d06cdc-1e58-4aec-b355-e02ca8c8cbb8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.945913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 781/1579] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:00 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:00.946851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06cdc-1e58-4aec-b355-e02ca8c8cbb8 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.955618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 799/1580] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:00 2022] POST /identity/v3/projects => generated 403 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:00.956504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06cdc-1e58-4aec-b355-e02ca8c8cbb8 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.956636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e0f49-94a7-4991-9b9d-098be8133d79 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.969905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:01.018031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc77cf6-14c8-4f79-9882-7ea23cb09c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.018872 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc77cf6-14c8-4f79-9882-7ea23cb09c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.019415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc77cf6-14c8-4f79-9882-7ea23cb09c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.019864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc77cf6-14c8-4f79-9882-7ea23cb09c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.021171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc77cf6-14c8-4f79-9882-7ea23cb09c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.022931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc77cf6-14c8-4f79-9882-7ea23cb09c75 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.026893 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e0f49-94a7-4991-9b9d-098be8133d79 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.031657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb16adf-0473-46ad-acff-1ee1772261a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.032262 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16adf-0473-46ad-acff-1ee1772261a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.037300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16adf-0473-46ad-acff-1ee1772261a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.037300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16adf-0473-46ad-acff-1ee1772261a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.038014 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 782/1581] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.038106 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb16adf-0473-46ad-acff-1ee1772261a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.038189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc77cf6-14c8-4f79-9882-7ea23cb09c75 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.038270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb16adf-0473-46ad-acff-1ee1772261a5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.044306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc77cf6-14c8-4f79-9882-7ea23cb09c75 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.049058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 800/1582] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.049058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb16adf-0473-46ad-acff-1ee1772261a5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.049917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e1bb0-01b4-43a5-a162-c7ad2f84580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.050560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e1bb0-01b4-43a5-a162-c7ad2f84580d admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.050850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e1bb0-01b4-43a5-a162-c7ad2f84580d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.051152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e1bb0-01b4-43a5-a162-c7ad2f84580d admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.051860 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e1bb0-01b4-43a5-a162-c7ad2f84580d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.054370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e1bb0-01b4-43a5-a162-c7ad2f84580d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.056855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb16adf-0473-46ad-acff-1ee1772261a5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.061450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd64bb-b2a5-47e9-93c2-a1822aa1e4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.062041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd64bb-b2a5-47e9-93c2-a1822aa1e4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.062326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd64bb-b2a5-47e9-93c2-a1822aa1e4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.062598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd64bb-b2a5-47e9-93c2-a1822aa1e4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.063264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd64bb-b2a5-47e9-93c2-a1822aa1e4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.064847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd64bb-b2a5-47e9-93c2-a1822aa1e4d7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.075781 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 801/1583] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.076581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd64bb-b2a5-47e9-93c2-a1822aa1e4d7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.086763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd64bb-b2a5-47e9-93c2-a1822aa1e4d7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.091442 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0c2c9-ea7e-4ad6-9eb1-b52f31e071e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.092017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0c2c9-ea7e-4ad6-9eb1-b52f31e071e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.092292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0c2c9-ea7e-4ad6-9eb1-b52f31e071e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.092565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0c2c9-ea7e-4ad6-9eb1-b52f31e071e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.093203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0c2c9-ea7e-4ad6-9eb1-b52f31e071e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.095182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0c2c9-ea7e-4ad6-9eb1-b52f31e071e2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.128176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 783/1584] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:01 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:01.129474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d94a62-1b47-495f-bad6-1e938801de55 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.129764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d94a62-1b47-495f-bad6-1e938801de55 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.130038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d94a62-1b47-495f-bad6-1e938801de55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.156378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d4d94a62-1b47-495f-bad6-1e938801de55 None None] MFA Rules not processed for user `c9ebf7ccd920438586529a86ddbf42eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:01.157656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d4d94a62-1b47-495f-bad6-1e938801de55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:01.194765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 802/1585] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:01 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:01.195743 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0c2c9-ea7e-4ad6-9eb1-b52f31e071e2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.205791 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0c2c9-ea7e-4ad6-9eb1-b52f31e071e2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.210983 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1cdf-91d6-41b6-83fc-1c21db6258d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.211601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1cdf-91d6-41b6-83fc-1c21db6258d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.211886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1cdf-91d6-41b6-83fc-1c21db6258d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.212287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1cdf-91d6-41b6-83fc-1c21db6258d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.212938 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf1cdf-91d6-41b6-83fc-1c21db6258d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.214545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf1cdf-91d6-41b6-83fc-1c21db6258d0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.224824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 784/1586] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:01.226150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d94a62-1b47-495f-bad6-1e938801de55 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.226617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 803/1587] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.227471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1cdf-91d6-41b6-83fc-1c21db6258d0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.237379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d94a62-1b47-495f-bad6-1e938801de55 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.238153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1cdf-91d6-41b6-83fc-1c21db6258d0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.243022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32753e2-f883-40aa-8356-59834fd529d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.243558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181f6fe-10ef-4926-973e-b3ddc05db4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.243776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32753e2-f883-40aa-8356-59834fd529d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.244060 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32753e2-f883-40aa-8356-59834fd529d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.244153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181f6fe-10ef-4926-973e-b3ddc05db4cf admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.244332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32753e2-f883-40aa-8356-59834fd529d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.244446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181f6fe-10ef-4926-973e-b3ddc05db4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.244677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181f6fe-10ef-4926-973e-b3ddc05db4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.244959 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32753e2-f883-40aa-8356-59834fd529d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.245319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181f6fe-10ef-4926-973e-b3ddc05db4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.246953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181f6fe-10ef-4926-973e-b3ddc05db4cf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.251367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32753e2-f883-40aa-8356-59834fd529d9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.257711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 804/1588] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.258529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181f6fe-10ef-4926-973e-b3ddc05db4cf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.268123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181f6fe-10ef-4926-973e-b3ddc05db4cf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.272953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758725-d4cf-432f-8102-3560a917256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.274348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758725-d4cf-432f-8102-3560a917256f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.274348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758725-d4cf-432f-8102-3560a917256f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.274348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0758725-d4cf-432f-8102-3560a917256f admin admin] PATH_INFO: `/v3/projects/f92872f1ad7841a484d31f723b8752db/users/4b806416f3a14a98b1cd34800da725d1/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.288626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:01.292198 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758725-d4cf-432f-8102-3560a917256f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92872f1ad7841a484d31f723b8752db, user_id=4b806416f3a14a98b1cd34800da725d1, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.295535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0758725-d4cf-432f-8102-3560a917256f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.326929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 785/1589] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:01 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:01.327921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32753e2-f883-40aa-8356-59834fd529d9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.338562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32753e2-f883-40aa-8356-59834fd529d9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.343326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1b367-42ff-4749-aee8-7f50df0be3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.343922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1b367-42ff-4749-aee8-7f50df0be3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.344232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1b367-42ff-4749-aee8-7f50df0be3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.344507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1b367-42ff-4749-aee8-7f50df0be3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.345150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1b367-42ff-4749-aee8-7f50df0be3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.346756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1b367-42ff-4749-aee8-7f50df0be3b4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.358421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 786/1590] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.359269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1b367-42ff-4749-aee8-7f50df0be3b4 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.369593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1b367-42ff-4749-aee8-7f50df0be3b4 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.374210 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3172f-f409-4835-85a3-02b083901706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.374788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3172f-f409-4835-85a3-02b083901706 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.375094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3172f-f409-4835-85a3-02b083901706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.375369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3172f-f409-4835-85a3-02b083901706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.376120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3172f-f409-4835-85a3-02b083901706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.377584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3172f-f409-4835-85a3-02b083901706 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.379135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 805/1591] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:01 2022] PUT /identity/v3/projects/f92872f1ad7841a484d31f723b8752db/users/4b806416f3a14a98b1cd34800da725d1/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:01.388056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 787/1592] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.391854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758725-d4cf-432f-8102-3560a917256f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.391989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3172f-f409-4835-85a3-02b083901706 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.400823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3172f-f409-4835-85a3-02b083901706 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.446150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:01.454773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0758725-d4cf-432f-8102-3560a917256f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.460124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e2e70-dbec-493f-90b1-739bdfdbe353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.460813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2e70-dbec-493f-90b1-739bdfdbe353 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.461097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2e70-dbec-493f-90b1-739bdfdbe353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.461372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2e70-dbec-493f-90b1-739bdfdbe353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.461805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2b62f-7b07-4181-857c-0c957b7a6827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.462031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e2e70-dbec-493f-90b1-739bdfdbe353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.462496 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b62f-7b07-4181-857c-0c957b7a6827 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.462947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b62f-7b07-4181-857c-0c957b7a6827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.463175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2b62f-7b07-4181-857c-0c957b7a6827 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.463765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e2e70-dbec-493f-90b1-739bdfdbe353 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.463879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2b62f-7b07-4181-857c-0c957b7a6827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.465756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2b62f-7b07-4181-857c-0c957b7a6827 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.474123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 806/1593] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.478002 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e2e70-dbec-493f-90b1-739bdfdbe353 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.487116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e2e70-dbec-493f-90b1-739bdfdbe353 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.491828 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c63d-73ca-4821-bbce-982f4d250b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.492425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c63d-73ca-4821-bbce-982f4d250b35 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.492720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c63d-73ca-4821-bbce-982f4d250b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.494913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c63d-73ca-4821-bbce-982f4d250b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.494913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786c63d-73ca-4821-bbce-982f4d250b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.495217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786c63d-73ca-4821-bbce-982f4d250b35 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.505144 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 807/1594] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.505935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c63d-73ca-4821-bbce-982f4d250b35 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.515038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c63d-73ca-4821-bbce-982f4d250b35 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.519690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab0f20-db2b-455f-8208-9b4e91957f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.520325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0f20-db2b-455f-8208-9b4e91957f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.520612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0f20-db2b-455f-8208-9b4e91957f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.520889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0f20-db2b-455f-8208-9b4e91957f90 admin admin] PATH_INFO: `/v3/projects/990b2fd7ef6b43bca7f3b445f3da19f3/users/7463c60513914e138878f6eaf0a87473/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.536482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab0f20-db2b-455f-8208-9b4e91957f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990b2fd7ef6b43bca7f3b445f3da19f3, user_id=7463c60513914e138878f6eaf0a87473, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.539789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab0f20-db2b-455f-8208-9b4e91957f90 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.573649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 788/1595] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:01 2022] POST /identity/v3/projects => generated 357 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:01.574758 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2b62f-7b07-4181-857c-0c957b7a6827 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.595752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 808/1596] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:01 2022] PUT /identity/v3/projects/990b2fd7ef6b43bca7f3b445f3da19f3/users/7463c60513914e138878f6eaf0a87473/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:01.596553 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab0f20-db2b-455f-8208-9b4e91957f90 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.638784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2b62f-7b07-4181-857c-0c957b7a6827 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.660435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab0f20-db2b-455f-8208-9b4e91957f90 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.665868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6767d-8db6-4f4c-bb32-bc612c755abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.666540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6767d-8db6-4f4c-bb32-bc612c755abc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.666827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6767d-8db6-4f4c-bb32-bc612c755abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.667136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6767d-8db6-4f4c-bb32-bc612c755abc admin admin] PATH_INFO: `/v3/projects/975ff359ca3f458c9008b497b474c93d/users/f844fed122764361a93664842d60070e/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.681985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6767d-8db6-4f4c-bb32-bc612c755abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=975ff359ca3f458c9008b497b474c93d, user_id=f844fed122764361a93664842d60070e, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.684780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6767d-8db6-4f4c-bb32-bc612c755abc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.701191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfed6a-3c00-406b-9a8f-7a54db7dcc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.701803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfed6a-3c00-406b-9a8f-7a54db7dcc82 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.712606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfed6a-3c00-406b-9a8f-7a54db7dcc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.712606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfed6a-3c00-406b-9a8f-7a54db7dcc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.712606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfed6a-3c00-406b-9a8f-7a54db7dcc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.712606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfed6a-3c00-406b-9a8f-7a54db7dcc82 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.715067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 789/1597] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.716347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771466-6dbb-4ddb-a919-df10b2d28031 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.716652 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771466-6dbb-4ddb-a919-df10b2d28031 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.716942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771466-6dbb-4ddb-a919-df10b2d28031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.743092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-68771466-6dbb-4ddb-a919-df10b2d28031 None None] MFA Rules not processed for user `4b806416f3a14a98b1cd34800da725d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:01.744294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-68771466-6dbb-4ddb-a919-df10b2d28031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:01.775589 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 809/1598] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:01 2022] PUT /identity/v3/projects/975ff359ca3f458c9008b497b474c93d/users/f844fed122764361a93664842d60070e/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:01.776421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6767d-8db6-4f4c-bb32-bc612c755abc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.813777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 790/1599] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:01.814598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68771466-6dbb-4ddb-a919-df10b2d28031 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.820444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:01.820599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:01.826668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68771466-6dbb-4ddb-a919-df10b2d28031 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.849606 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6767d-8db6-4f4c-bb32-bc612c755abc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.856074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bdf5f-12e9-45ee-9993-38711a63c71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.856680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bdf5f-12e9-45ee-9993-38711a63c71e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.857009 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bdf5f-12e9-45ee-9993-38711a63c71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.861580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bdf5f-12e9-45ee-9993-38711a63c71e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.861580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bdf5f-12e9-45ee-9993-38711a63c71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.861580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bdf5f-12e9-45ee-9993-38711a63c71e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.871961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 810/1600] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.872925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bdf5f-12e9-45ee-9993-38711a63c71e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.884391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bdf5f-12e9-45ee-9993-38711a63c71e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.891650 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae2dbc-7171-4b80-9767-0ca44b6df75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.892284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae2dbc-7171-4b80-9767-0ca44b6df75a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.892563 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae2dbc-7171-4b80-9767-0ca44b6df75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.892835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae2dbc-7171-4b80-9767-0ca44b6df75a admin admin] PATH_INFO: `/v3/projects/aa03db21be08483d94a38d940914e004/users/c55dbc02c6bc4b459a3491283c5cad48/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.894266 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee197c76-f474-4697-b34d-657fc7f1c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.895470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee197c76-f474-4697-b34d-657fc7f1c6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.896096 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee197c76-f474-4697-b34d-657fc7f1c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.896733 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee197c76-f474-4697-b34d-657fc7f1c6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.898512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee197c76-f474-4697-b34d-657fc7f1c6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.901665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee197c76-f474-4697-b34d-657fc7f1c6cd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.909081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae2dbc-7171-4b80-9767-0ca44b6df75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa03db21be08483d94a38d940914e004, user_id=c55dbc02c6bc4b459a3491283c5cad48, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.912904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae2dbc-7171-4b80-9767-0ca44b6df75a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.918942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 791/1601] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:01.918942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee197c76-f474-4697-b34d-657fc7f1c6cd admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.926543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee197c76-f474-4697-b34d-657fc7f1c6cd admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.931816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bdb57-49a7-49a8-9f8e-95ff1c76a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.932393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bdb57-49a7-49a8-9f8e-95ff1c76a173 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.932670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bdb57-49a7-49a8-9f8e-95ff1c76a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.932941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bdb57-49a7-49a8-9f8e-95ff1c76a173 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.933562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bdb57-49a7-49a8-9f8e-95ff1c76a173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.935516 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bdb57-49a7-49a8-9f8e-95ff1c76a173 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.991147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 811/1602] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:01 2022] PUT /identity/v3/projects/aa03db21be08483d94a38d940914e004/users/c55dbc02c6bc4b459a3491283c5cad48/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:01.993146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ad2de-fcaa-4be9-849c-e0919ab3734a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.993433 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ad2de-fcaa-4be9-849c-e0919ab3734a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.993710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ad2de-fcaa-4be9-849c-e0919ab3734a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.012984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-119ad2de-fcaa-4be9-849c-e0919ab3734a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.014195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-119ad2de-fcaa-4be9-849c-e0919ab3734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.019152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 792/1603] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:01 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:02.020028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bdb57-49a7-49a8-9f8e-95ff1c76a173 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.029775 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bdb57-49a7-49a8-9f8e-95ff1c76a173 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.077605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 812/1604] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.079290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c2fb-aa93-437c-a943-272c986da62c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.079579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c2fb-aa93-437c-a943-272c986da62c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.079856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c2fb-aa93-437c-a943-272c986da62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.091715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d565460-23ca-42cf-b366-3ebed9869fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.092473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565460-23ca-42cf-b366-3ebed9869fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.092857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565460-23ca-42cf-b366-3ebed9869fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.093257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d565460-23ca-42cf-b366-3ebed9869fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.093990 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d565460-23ca-42cf-b366-3ebed9869fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.095721 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d565460-23ca-42cf-b366-3ebed9869fa4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.098915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-be21c2fb-aa93-437c-a943-272c986da62c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.100746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be21c2fb-aa93-437c-a943-272c986da62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.110315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 793/1605] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:02.110315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865d852-f6fc-453a-a1c7-2d866e23a5b0 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.110577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 813/1606] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.110670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865d852-f6fc-453a-a1c7-2d866e23a5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.110670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865d852-f6fc-453a-a1c7-2d866e23a5b0 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.110843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21c2fb-aa93-437c-a943-272c986da62c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.111251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 794/1607] 10.222.0.88 () {54 vars in 962 bytes} [Wed Aug 24 03:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:02.116186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865d852-f6fc-453a-a1c7-2d866e23a5b0 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.127147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21c2fb-aa93-437c-a943-272c986da62c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.128988 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865d852-f6fc-453a-a1c7-2d866e23a5b0 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.131950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75425b-7489-484e-98c2-9f593529e56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.132602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75425b-7489-484e-98c2-9f593529e56b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.132880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75425b-7489-484e-98c2-9f593529e56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.133152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75425b-7489-484e-98c2-9f593529e56b admin admin] PATH_INFO: `/v3/projects/bffce6843cd84332b456422305e102ec/users/80d12d339c7e4908bb3fd773db3060cc/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.133757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681db03-bdfd-4100-939c-5f63b1107371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.134442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681db03-bdfd-4100-939c-5f63b1107371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.134721 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681db03-bdfd-4100-939c-5f63b1107371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.134993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681db03-bdfd-4100-939c-5f63b1107371 admin admin] PATH_INFO: `/v3/projects/a2a5954902254a7c8877476e09cb7094/users/7f4db893c9404bf7b97c5b3ac47c9a81/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.148424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75425b-7489-484e-98c2-9f593529e56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffce6843cd84332b456422305e102ec, user_id=80d12d339c7e4908bb3fd773db3060cc, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.151023 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75425b-7489-484e-98c2-9f593529e56b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.151488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681db03-bdfd-4100-939c-5f63b1107371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a5954902254a7c8877476e09cb7094, user_id=7f4db893c9404bf7b97c5b3ac47c9a81, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.152526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-4681db03-bdfd-4100-939c-5f63b1107371 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:48:02.152526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Aug 24 03:48:02.152526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: Aug 24 03:48:02.154476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681db03-bdfd-4100-939c-5f63b1107371 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.235580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 814/1608] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:02 2022] PUT /identity/v3/projects/bffce6843cd84332b456422305e102ec/users/80d12d339c7e4908bb3fd773db3060cc/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:02.237022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c753c-a2ba-46f0-a984-c5e962370bfd None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.237376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c753c-a2ba-46f0-a984-c5e962370bfd None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.237659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c753c-a2ba-46f0-a984-c5e962370bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.247352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 795/1609] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:02 2022] PUT /identity/v3/projects/a2a5954902254a7c8877476e09cb7094/users/7f4db893c9404bf7b97c5b3ac47c9a81/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:02.248654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681db03-bdfd-4100-939c-5f63b1107371 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.257005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4a6c753c-a2ba-46f0-a984-c5e962370bfd None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.258105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4a6c753c-a2ba-46f0-a984-c5e962370bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.305215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:02.315478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681db03-bdfd-4100-939c-5f63b1107371 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.320435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e4a07-8e4c-42df-a4cf-a8a1f8097cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.321044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4a07-8e4c-42df-a4cf-a8a1f8097cee admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.321346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4a07-8e4c-42df-a4cf-a8a1f8097cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.321620 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4a07-8e4c-42df-a4cf-a8a1f8097cee admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.322268 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e4a07-8e4c-42df-a4cf-a8a1f8097cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.323029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 815/1610] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.323936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e4a07-8e4c-42df-a4cf-a8a1f8097cee admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.324059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c753c-a2ba-46f0-a984-c5e962370bfd None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.336095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 796/1611] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:02.336919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e4a07-8e4c-42df-a4cf-a8a1f8097cee admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.346485 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e4a07-8e4c-42df-a4cf-a8a1f8097cee admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.346974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:02.352368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f18195-6c95-41a3-970f-25c8c508b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.353038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f18195-6c95-41a3-970f-25c8c508b106 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.353322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f18195-6c95-41a3-970f-25c8c508b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.353600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f18195-6c95-41a3-970f-25c8c508b106 admin admin] PATH_INFO: `/v3/projects/c1f907babf824901a0ec40e3b6d80494/users/becc65ff0cad4d3891b327e0e8890a49/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.369719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f18195-6c95-41a3-970f-25c8c508b106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f907babf824901a0ec40e3b6d80494, user_id=becc65ff0cad4d3891b327e0e8890a49, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.372465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f18195-6c95-41a3-970f-25c8c508b106 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.383183 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c753c-a2ba-46f0-a984-c5e962370bfd None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.386815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25069e-9dd1-4382-a4c9-147571fac063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.387487 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25069e-9dd1-4382-a4c9-147571fac063 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.387776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25069e-9dd1-4382-a4c9-147571fac063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.388053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25069e-9dd1-4382-a4c9-147571fac063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.397398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25069e-9dd1-4382-a4c9-147571fac063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.398896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25069e-9dd1-4382-a4c9-147571fac063 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.408505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 816/1612] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:02.409776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7ce0-3b41-4027-9f58-e13a2d239078 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.409996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7ce0-3b41-4027-9f58-e13a2d239078 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.410275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7ce0-3b41-4027-9f58-e13a2d239078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.447525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d37e7ce0-3b41-4027-9f58-e13a2d239078 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.448726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d37e7ce0-3b41-4027-9f58-e13a2d239078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.458574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 797/1613] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:02 2022] PUT /identity/v3/projects/c1f907babf824901a0ec40e3b6d80494/users/becc65ff0cad4d3891b327e0e8890a49/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:02.460589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f18195-6c95-41a3-970f-25c8c508b106 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.517103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 817/1614] 10.222.0.88 () {58 vars in 1059 bytes} [Wed Aug 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.517576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f18195-6c95-41a3-970f-25c8c508b106 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.518232 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27059c43-fe4e-4b3e-aad0-003ebabef7ee None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.518479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27059c43-fe4e-4b3e-aad0-003ebabef7ee None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.518733 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27059c43-fe4e-4b3e-aad0-003ebabef7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.521707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4906c9-07fa-44a3-858c-49aa89b9675e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.522451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4906c9-07fa-44a3-858c-49aa89b9675e service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.522732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4906c9-07fa-44a3-858c-49aa89b9675e service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.523006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4906c9-07fa-44a3-858c-49aa89b9675e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.539171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-27059c43-fe4e-4b3e-aad0-003ebabef7ee None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.540405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-27059c43-fe4e-4b3e-aad0-003ebabef7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.598746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4906c9-07fa-44a3-858c-49aa89b9675e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.601043 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4906c9-07fa-44a3-858c-49aa89b9675e service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.611717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 798/1615] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:02.613117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64f4c-e0ef-4cc9-a9e9-6d3c2a6ad041 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.613420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64f4c-e0ef-4cc9-a9e9-6d3c2a6ad041 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.613700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64f4c-e0ef-4cc9-a9e9-6d3c2a6ad041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.618628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 818/1616] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.618628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27059c43-fe4e-4b3e-aad0-003ebabef7ee None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.627255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27059c43-fe4e-4b3e-aad0-003ebabef7ee None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.632301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcf592-3dfe-438a-acc9-43f6e8a48c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.632948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf592-3dfe-438a-acc9-43f6e8a48c9a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.633225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf592-3dfe-438a-acc9-43f6e8a48c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.633496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf592-3dfe-438a-acc9-43f6e8a48c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.636642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-dce64f4c-e0ef-4cc9-a9e9-6d3c2a6ad041 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.638015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dce64f4c-e0ef-4cc9-a9e9-6d3c2a6ad041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.643988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcf592-3dfe-438a-acc9-43f6e8a48c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.645493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcf592-3dfe-438a-acc9-43f6e8a48c9a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.645920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 799/1617] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.651214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64f4c-e0ef-4cc9-a9e9-6d3c2a6ad041 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.656687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 819/1618] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:02.657862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee7fa3-1bae-4bd7-844d-2b6f2d2788df None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.658262 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee7fa3-1bae-4bd7-844d-2b6f2d2788df None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.658548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee7fa3-1bae-4bd7-844d-2b6f2d2788df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.659857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64f4c-e0ef-4cc9-a9e9-6d3c2a6ad041 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.665671 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6518-af07-4e37-a663-e86b92dfe2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.666398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6518-af07-4e37-a663-e86b92dfe2d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.666685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6518-af07-4e37-a663-e86b92dfe2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.667119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db6518-af07-4e37-a663-e86b92dfe2d4 admin admin] PATH_INFO: `/v3/projects/037d28f4d2e44ab2bca41cf961d43c4a/users/51b79b9b1ed34f50a262e23f4b5d568c/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.684022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db6518-af07-4e37-a663-e86b92dfe2d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=037d28f4d2e44ab2bca41cf961d43c4a, user_id=51b79b9b1ed34f50a262e23f4b5d568c, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.686669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db6518-af07-4e37-a663-e86b92dfe2d4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.697323 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2cee7fa3-1bae-4bd7-844d-2b6f2d2788df None None] MFA Rules not processed for user `becc65ff0cad4d3891b327e0e8890a49`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.698565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2cee7fa3-1bae-4bd7-844d-2b6f2d2788df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.712009 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:02.757890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 800/1619] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:02 2022] PUT /identity/v3/projects/037d28f4d2e44ab2bca41cf961d43c4a/users/51b79b9b1ed34f50a262e23f4b5d568c/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:02.760182 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6518-af07-4e37-a663-e86b92dfe2d4 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.777325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 820/1620] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.777325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee7fa3-1bae-4bd7-844d-2b6f2d2788df None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.779064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2cee7fa3-1bae-4bd7-844d-2b6f2d2788df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.795151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee7fa3-1bae-4bd7-844d-2b6f2d2788df None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.813324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:02.845054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db6518-af07-4e37-a663-e86b92dfe2d4 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.855901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec23b2-cde4-4ca0-b734-1c2b0ec03769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.856894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec23b2-cde4-4ca0-b734-1c2b0ec03769 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.857251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec23b2-cde4-4ca0-b734-1c2b0ec03769 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.857546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec23b2-cde4-4ca0-b734-1c2b0ec03769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.870241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df480e56-4240-41f6-958d-54160a8537ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.871108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480e56-4240-41f6-958d-54160a8537ae service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.871547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480e56-4240-41f6-958d-54160a8537ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.871989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480e56-4240-41f6-958d-54160a8537ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.925439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec23b2-cde4-4ca0-b734-1c2b0ec03769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.927271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec23b2-cde4-4ca0-b734-1c2b0ec03769 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.947387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 801/1621] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:02.948140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec23b2-cde4-4ca0-b734-1c2b0ec03769 service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.951004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df480e56-4240-41f6-958d-54160a8537ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.953180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df480e56-4240-41f6-958d-54160a8537ae service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.967869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec23b2-cde4-4ca0-b734-1c2b0ec03769 service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.967980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 821/1622] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:02.968411 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df480e56-4240-41f6-958d-54160a8537ae service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.972571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5826e-a3e6-42ff-be75-2a12a20551fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.975595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5826e-a3e6-42ff-be75-2a12a20551fe service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.975916 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5826e-a3e6-42ff-be75-2a12a20551fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.976196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5826e-a3e6-42ff-be75-2a12a20551fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.980548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df480e56-4240-41f6-958d-54160a8537ae service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.985676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7d0bb-7297-4dfe-8dd2-98fd6dec5437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.986299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d0bb-7297-4dfe-8dd2-98fd6dec5437 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.986585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d0bb-7297-4dfe-8dd2-98fd6dec5437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.986864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d0bb-7297-4dfe-8dd2-98fd6dec5437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.987564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7d0bb-7297-4dfe-8dd2-98fd6dec5437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.989274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7d0bb-7297-4dfe-8dd2-98fd6dec5437 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.996002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5826e-a3e6-42ff-be75-2a12a20551fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.999226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5826e-a3e6-42ff-be75-2a12a20551fe service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.001019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 822/1623] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:03.001929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7d0bb-7297-4dfe-8dd2-98fd6dec5437 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.014122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7d0bb-7297-4dfe-8dd2-98fd6dec5437 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.019652 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 802/1624] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:03.019652 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5826e-a3e6-42ff-be75-2a12a20551fe service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.029035 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b107ba4-ec46-4377-827a-83d08eb1aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.029629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5826e-a3e6-42ff-be75-2a12a20551fe service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.029819 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b107ba4-ec46-4377-827a-83d08eb1aac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.030118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b107ba4-ec46-4377-827a-83d08eb1aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.030399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b107ba4-ec46-4377-827a-83d08eb1aac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.031492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b107ba4-ec46-4377-827a-83d08eb1aac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.034077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b107ba4-ec46-4377-827a-83d08eb1aac7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.035307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c4e5d-4a3a-4cc8-a1a2-9f40363fdc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.036210 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c4e5d-4a3a-4cc8-a1a2-9f40363fdc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.036488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c4e5d-4a3a-4cc8-a1a2-9f40363fdc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.036867 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c4e5d-4a3a-4cc8-a1a2-9f40363fdc55 admin admin] PATH_INFO: `/v3/projects/037d28f4d2e44ab2bca41cf961d43c4a/users/51b79b9b1ed34f50a262e23f4b5d568c/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.039553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c4e5d-4a3a-4cc8-a1a2-9f40363fdc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=037d28f4d2e44ab2bca41cf961d43c4a, user_id=51b79b9b1ed34f50a262e23f4b5d568c, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.042429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c4e5d-4a3a-4cc8-a1a2-9f40363fdc55 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.055085 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 803/1625] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:03 2022] PUT /identity/v3/projects/037d28f4d2e44ab2bca41cf961d43c4a/users/51b79b9b1ed34f50a262e23f4b5d568c/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:03.067464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d8ee8-584e-45ae-924f-e34af8784fd9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.088317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d8ee8-584e-45ae-924f-e34af8784fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.088317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d8ee8-584e-45ae-924f-e34af8784fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.130797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c80d8ee8-584e-45ae-924f-e34af8784fd9 None None] MFA Rules not processed for user `51b79b9b1ed34f50a262e23f4b5d568c`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:03.132384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c80d8ee8-584e-45ae-924f-e34af8784fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:03.261431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 823/1626] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:03 2022] POST /identity/v3/projects => generated 405 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:03.262923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d1a79-f549-44b5-b492-907fcd9751b3 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.263254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d1a79-f549-44b5-b492-907fcd9751b3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.263619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d1a79-f549-44b5-b492-907fcd9751b3 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.265409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 824/1627] 10.222.0.88 () {54 vars in 912 bytes} [Wed Aug 24 03:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:03.266155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d1a79-f549-44b5-b492-907fcd9751b3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.289580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 804/1628] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:03.289580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8f3d-4c44-4016-85e7-7fc1b5472511 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.289580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8f3d-4c44-4016-85e7-7fc1b5472511 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.289580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8f3d-4c44-4016-85e7-7fc1b5472511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.308858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:03.312827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ad1d8f3d-4c44-4016-85e7-7fc1b5472511 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:03.314685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ad1d8f3d-4c44-4016-85e7-7fc1b5472511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:03.345406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d1a79-f549-44b5-b492-907fcd9751b3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.352779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e63b-9b39-4105-8171-e9b118b340a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.354293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e63b-9b39-4105-8171-e9b118b340a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.354899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e63b-9b39-4105-8171-e9b118b340a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.355440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e63b-9b39-4105-8171-e9b118b340a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.356505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9e63b-9b39-4105-8171-e9b118b340a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.358811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:03.359691 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9e63b-9b39-4105-8171-e9b118b340a4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.403419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 805/1629] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:03.404747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8f3d-4c44-4016-85e7-7fc1b5472511 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.478924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 825/1630] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:03 2022] POST /identity/v3/users => generated 309 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:03.478924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e63b-9b39-4105-8171-e9b118b340a4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.479399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8f3d-4c44-4016-85e7-7fc1b5472511 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.491092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e63b-9b39-4105-8171-e9b118b340a4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.493988 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32d571-0123-4572-a5fb-93b062d4945d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.494291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32d571-0123-4572-a5fb-93b062d4945d service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.494526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32d571-0123-4572-a5fb-93b062d4945d service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.494803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32d571-0123-4572-a5fb-93b062d4945d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.498224 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e3e53-0007-45f8-8e6d-255a3ed42126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.498839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e3e53-0007-45f8-8e6d-255a3ed42126 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.499145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e3e53-0007-45f8-8e6d-255a3ed42126 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.499416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e3e53-0007-45f8-8e6d-255a3ed42126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.516774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e3e53-0007-45f8-8e6d-255a3ed42126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.518252 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e3e53-0007-45f8-8e6d-255a3ed42126 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.533942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 826/1631] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:03.535016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e3e53-0007-45f8-8e6d-255a3ed42126 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.545936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e3e53-0007-45f8-8e6d-255a3ed42126 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.551740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771801d-e34f-44c8-bfe4-6d42b95a4791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.552433 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771801d-e34f-44c8-bfe4-6d42b95a4791 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.552796 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771801d-e34f-44c8-bfe4-6d42b95a4791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.553726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771801d-e34f-44c8-bfe4-6d42b95a4791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.554633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771801d-e34f-44c8-bfe4-6d42b95a4791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.556940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771801d-e34f-44c8-bfe4-6d42b95a4791 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.590651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 827/1632] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:03.595299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771801d-e34f-44c8-bfe4-6d42b95a4791 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.622036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771801d-e34f-44c8-bfe4-6d42b95a4791 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.631296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909aa59-7682-479c-b8e7-d7f499fb3569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.631513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909aa59-7682-479c-b8e7-d7f499fb3569 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.631802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909aa59-7682-479c-b8e7-d7f499fb3569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.633625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909aa59-7682-479c-b8e7-d7f499fb3569 admin admin] PATH_INFO: `/v3/projects/1178559915d24e659a6006afb66aff10/users/1d095001198b4e9da2e15f985e6bbf52/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.645734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32d571-0123-4572-a5fb-93b062d4945d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.648068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32d571-0123-4572-a5fb-93b062d4945d service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.673109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909aa59-7682-479c-b8e7-d7f499fb3569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1178559915d24e659a6006afb66aff10, user_id=1d095001198b4e9da2e15f985e6bbf52, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.675969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909aa59-7682-479c-b8e7-d7f499fb3569 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.685370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 806/1633] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:03.756821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 828/1634] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:03 2022] PUT /identity/v3/projects/1178559915d24e659a6006afb66aff10/users/1d095001198b4e9da2e15f985e6bbf52/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:03.760763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32d571-0123-4572-a5fb-93b062d4945d service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.779357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32d571-0123-4572-a5fb-93b062d4945d service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.900805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa4aef-6cb4-40e4-9128-5c9fe384718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.901786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4aef-6cb4-40e4-9128-5c9fe384718a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.903941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4aef-6cb4-40e4-9128-5c9fe384718a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.903941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4aef-6cb4-40e4-9128-5c9fe384718a admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.905285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa4aef-6cb4-40e4-9128-5c9fe384718a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.907743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa4aef-6cb4-40e4-9128-5c9fe384718a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.926714 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 807/1635] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:03.928216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909aa59-7682-479c-b8e7-d7f499fb3569 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.942300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909aa59-7682-479c-b8e7-d7f499fb3569 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.955385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37c3b1-5d9b-4266-816e-f70d95203009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.961375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37c3b1-5d9b-4266-816e-f70d95203009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.961375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37c3b1-5d9b-4266-816e-f70d95203009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.969960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37c3b1-5d9b-4266-816e-f70d95203009 admin admin] PATH_INFO: `/v3/projects/1178559915d24e659a6006afb66aff10/users/1d095001198b4e9da2e15f985e6bbf52/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.971030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37c3b1-5d9b-4266-816e-f70d95203009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1178559915d24e659a6006afb66aff10, user_id=1d095001198b4e9da2e15f985e6bbf52, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.978613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa4aef-6cb4-40e4-9128-5c9fe384718a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.978933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37c3b1-5d9b-4266-816e-f70d95203009 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.994398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 829/1636] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:03 2022] PUT /identity/v3/projects/1178559915d24e659a6006afb66aff10/users/1d095001198b4e9da2e15f985e6bbf52/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:04.005058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea8dc-86db-42d1-9a7e-f1b6a8f1c6a0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.005365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea8dc-86db-42d1-9a7e-f1b6a8f1c6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.005638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea8dc-86db-42d1-9a7e-f1b6a8f1c6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.011560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:04.042590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f7bea8dc-86db-42d1-9a7e-f1b6a8f1c6a0 None None] MFA Rules not processed for user `1d095001198b4e9da2e15f985e6bbf52`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:04.044424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f7bea8dc-86db-42d1-9a7e-f1b6a8f1c6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:04.080947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa4aef-6cb4-40e4-9128-5c9fe384718a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:04.141660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 830/1637] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:04.175708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11ee2f-7f9f-4d39-8891-edf1033314bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:04.176336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11ee2f-7f9f-4d39-8891-edf1033314bb service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.176619 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11ee2f-7f9f-4d39-8891-edf1033314bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.176894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11ee2f-7f9f-4d39-8891-edf1033314bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.266907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11ee2f-7f9f-4d39-8891-edf1033314bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:04.269362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11ee2f-7f9f-4d39-8891-edf1033314bb service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:04.281209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 808/1638] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:04.766007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea8dc-86db-42d1-9a7e-f1b6a8f1c6a0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:04.788211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea8dc-86db-42d1-9a7e-f1b6a8f1c6a0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:04.788211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb14f2-fc35-43bf-8723-50e4f86b77e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:04.788211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb14f2-fc35-43bf-8723-50e4f86b77e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.788211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb14f2-fc35-43bf-8723-50e4f86b77e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.788850 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb14f2-fc35-43bf-8723-50e4f86b77e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.803082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb14f2-fc35-43bf-8723-50e4f86b77e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:04.803507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb14f2-fc35-43bf-8723-50e4f86b77e5 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:04.816664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 831/1639] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:04 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:05.166785 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11ee2f-7f9f-4d39-8891-edf1033314bb service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:05.264388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11ee2f-7f9f-4d39-8891-edf1033314bb service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:05.265936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:05.266819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.267180 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.267565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] PATH_INFO: `/v3/users/becc65ff0cad4d3891b327e0e8890a49` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.269185 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=becc65ff0cad4d3891b327e0e8890a49)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:05.270455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: WARNING py.warnings [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:48:05.270455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: warnings.warn(msg) Aug 24 03:48:05.270455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: Aug 24 03:48:05.273114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:05.411535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c0a1b-bb6f-46cc-9cd8-ae552558c892 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.411827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c0a1b-bb6f-46cc-9cd8-ae552558c892 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.412104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c0a1b-bb6f-46cc-9cd8-ae552558c892 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.414215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 832/1640] 10.222.0.88 () {54 vars in 962 bytes} [Wed Aug 24 03:48:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:05.421975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc762-1f90-4cf4-919e-b1b442b83592 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.422256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc762-1f90-4cf4-919e-b1b442b83592 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.422530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc762-1f90-4cf4-919e-b1b442b83592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.461069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d9fbc762-1f90-4cf4-919e-b1b442b83592 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:05.463444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d9fbc762-1f90-4cf4-919e-b1b442b83592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:05.511579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:05.551708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:05.564532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 833/1641] 10.222.0.88 () {58 vars in 1059 bytes} [Wed Aug 24 03:48:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:05.573154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ad4bd-0564-4299-8fc5-cdf9f32ee722 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.573510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ad4bd-0564-4299-8fc5-cdf9f32ee722 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.574330 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ad4bd-0564-4299-8fc5-cdf9f32ee722 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.575958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 834/1642] 10.222.0.88 () {54 vars in 912 bytes} [Wed Aug 24 03:48:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:48:05.580466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'becc65ff0cad4d3891b327e0e8890a49'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.586450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495718e1-92fd-4dab-9400-1abfcbb5a578 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.586856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495718e1-92fd-4dab-9400-1abfcbb5a578 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.587290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495718e1-92fd-4dab-9400-1abfcbb5a578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.617627 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-495718e1-92fd-4dab-9400-1abfcbb5a578 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:05.619944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-495718e1-92fd-4dab-9400-1abfcbb5a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:05.637483 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 835/1643] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:05.647632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495718e1-92fd-4dab-9400-1abfcbb5a578 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:05.657706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495718e1-92fd-4dab-9400-1abfcbb5a578 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:05.661609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788aea1-d981-4235-aeac-90c5907d780c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:05.662552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788aea1-d981-4235-aeac-90c5907d780c service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.662958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788aea1-d981-4235-aeac-90c5907d780c service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.663368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788aea1-d981-4235-aeac-90c5907d780c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.690343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788aea1-d981-4235-aeac-90c5907d780c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:05.692334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788aea1-d981-4235-aeac-90c5907d780c service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:05.707373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 836/1644] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:05.756765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'becc65ff0cad4d3891b327e0e8890a49'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.785181 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'becc65ff0cad4d3891b327e0e8890a49'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.790290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'becc65ff0cad4d3891b327e0e8890a49'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.831927 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'becc65ff0cad4d3891b327e0e8890a49'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.849771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 809/1645] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:05 2022] DELETE /identity/v3/users/becc65ff0cad4d3891b327e0e8890a49 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:05.851744 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a51a7-ed87-4dff-bfda-5cf1fb0938b2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.851744 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a51a7-ed87-4dff-bfda-5cf1fb0938b2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.852365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a51a7-ed87-4dff-bfda-5cf1fb0938b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.890945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1c2a51a7-ed87-4dff-bfda-5cf1fb0938b2 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:05.892719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1c2a51a7-ed87-4dff-bfda-5cf1fb0938b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:05.975137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 837/1646] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:05.995600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:05.997631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:06.095134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6afcb-7370-4ff2-ac0d-06d35c359460 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:06.099573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ec79d-d17f-48fd-80f8-fd57c03c4e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:06.115168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec79d-d17f-48fd-80f8-fd57c03c4e31 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:06.115642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec79d-d17f-48fd-80f8-fd57c03c4e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:06.115810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ec79d-d17f-48fd-80f8-fd57c03c4e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:06.132918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ec79d-d17f-48fd-80f8-fd57c03c4e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:06.134749 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ec79d-d17f-48fd-80f8-fd57c03c4e31 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:06.146274 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 810/1647] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:07.430937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a51a7-ed87-4dff-bfda-5cf1fb0938b2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:07.437936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1c2a51a7-ed87-4dff-bfda-5cf1fb0938b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:07.449197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a51a7-ed87-4dff-bfda-5cf1fb0938b2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:07.456344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:07.457134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:07.457493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:07.458236 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] PATH_INFO: `/v3/projects/c1f907babf824901a0ec40e3b6d80494` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:07.460319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f907babf824901a0ec40e3b6d80494)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:07.461768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: WARNING py.warnings [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:48:07.461768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: warnings.warn(msg) Aug 24 03:48:07.461768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: Aug 24 03:48:07.462988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:07.728901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f907babf824901a0ec40e3b6d80494', 'request_id': 'req-c41dc954-8de9-4e42-96b9-102c5b5d2845'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.848194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f907babf824901a0ec40e3b6d80494', 'request_id': 'req-c41dc954-8de9-4e42-96b9-102c5b5d2845'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.857748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f907babf824901a0ec40e3b6d80494', 'request_id': 'req-c41dc954-8de9-4e42-96b9-102c5b5d2845'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.899384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] The token cache is being invalidate because project c1f907babf824901a0ec40e3b6d80494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:07.899384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.899384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.908196 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 838/1648] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:07 2022] DELETE /identity/v3/projects/c1f907babf824901a0ec40e3b6d80494 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:07.915080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ec79d-d17f-48fd-80f8-fd57c03c4e31 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:07.936319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ec79d-d17f-48fd-80f8-fd57c03c4e31 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:08.110015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:08.111184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:08.111828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:08.112292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] PATH_INFO: `/v3/users/1d095001198b4e9da2e15f985e6bbf52` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:08.114750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d095001198b4e9da2e15f985e6bbf52)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:08.117678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:08.676724 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d095001198b4e9da2e15f985e6bbf52'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.688816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:08.779850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d095001198b4e9da2e15f985e6bbf52'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.801951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d095001198b4e9da2e15f985e6bbf52'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.805362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d095001198b4e9da2e15f985e6bbf52'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.836110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d095001198b4e9da2e15f985e6bbf52'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.865512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 811/1649] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:07 2022] DELETE /identity/v3/users/1d095001198b4e9da2e15f985e6bbf52 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:09.070693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.073652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:09.120337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dc954-8de9-4e42-96b9-102c5b5d2845 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.234632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:09.392758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201d533-a13a-4410-805b-288b235d01b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.393608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d533-a13a-4410-805b-288b235d01b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.394032 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d533-a13a-4410-805b-288b235d01b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.394457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d533-a13a-4410-805b-288b235d01b1 admin admin] PATH_INFO: `/v3/users/4b806416f3a14a98b1cd34800da725d1` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.397227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201d533-a13a-4410-805b-288b235d01b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b806416f3a14a98b1cd34800da725d1)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.399367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201d533-a13a-4410-805b-288b235d01b1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:09.737771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5201d533-a13a-4410-805b-288b235d01b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b806416f3a14a98b1cd34800da725d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:09.740525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5201d533-a13a-4410-805b-288b235d01b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b806416f3a14a98b1cd34800da725d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:09.745708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5201d533-a13a-4410-805b-288b235d01b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b806416f3a14a98b1cd34800da725d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:09.830904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5201d533-a13a-4410-805b-288b235d01b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b806416f3a14a98b1cd34800da725d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:09.906398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.909113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:09.940324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5201d533-a13a-4410-805b-288b235d01b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b806416f3a14a98b1cd34800da725d1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:09.951491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92893b2-b26c-45d6-b690-dc8e0c40882c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.966421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.968679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.969205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.970214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] PATH_INFO: `/v3/projects/1178559915d24e659a6006afb66aff10` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.983163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1178559915d24e659a6006afb66aff10)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.996356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.038958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 839/1650] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:09 2022] DELETE /identity/v3/users/4b806416f3a14a98b1cd34800da725d1 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:10.058576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23f9d-a6bf-4ad4-8dd1-e479b8adf36f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.059115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23f9d-a6bf-4ad4-8dd1-e479b8adf36f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.059572 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23f9d-a6bf-4ad4-8dd1-e479b8adf36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.116333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-96e23f9d-a6bf-4ad4-8dd1-e479b8adf36f None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:10.118481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96e23f9d-a6bf-4ad4-8dd1-e479b8adf36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:10.219808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1178559915d24e659a6006afb66aff10', 'request_id': 'req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:10.256702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1178559915d24e659a6006afb66aff10', 'request_id': 'req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:10.324007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 840/1651] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:10.366135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23f9d-a6bf-4ad4-8dd1-e479b8adf36f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.374669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96e23f9d-a6bf-4ad4-8dd1-e479b8adf36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:10.382764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1178559915d24e659a6006afb66aff10', 'request_id': 'req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:10.452180 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] The token cache is being invalidate because project 1178559915d24e659a6006afb66aff10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:10.454011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:10.461002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-28b9ad48-3276-438c-a7cf-2eb7a74d2dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:10.471927 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 812/1652] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:09 2022] DELETE /identity/v3/projects/1178559915d24e659a6006afb66aff10 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:10.477938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202dae-98b0-4c90-a1a7-c776fb39c534 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.486088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202dae-98b0-4c90-a1a7-c776fb39c534 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.486088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202dae-98b0-4c90-a1a7-c776fb39c534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.534602 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-53202dae-98b0-4c90-a1a7-c776fb39c534 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:10.538132 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-53202dae-98b0-4c90-a1a7-c776fb39c534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:10.620132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23f9d-a6bf-4ad4-8dd1-e479b8adf36f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.739117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 813/1653] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:10.742907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9247a9-74a3-4bed-98fc-c62b73d8c91e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.743385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9247a9-74a3-4bed-98fc-c62b73d8c91e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.747236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9247a9-74a3-4bed-98fc-c62b73d8c91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.779161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c240f5d-e91b-4491-bbd0-d6dcce817717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.779161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c240f5d-e91b-4491-bbd0-d6dcce817717 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.779161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c240f5d-e91b-4491-bbd0-d6dcce817717 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.779161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c240f5d-e91b-4491-bbd0-d6dcce817717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.779594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c240f5d-e91b-4491-bbd0-d6dcce817717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:10.786736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-dc9247a9-74a3-4bed-98fc-c62b73d8c91e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:10.790972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dc9247a9-74a3-4bed-98fc-c62b73d8c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:10.802646 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c240f5d-e91b-4491-bbd0-d6dcce817717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.805612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c240f5d-e91b-4491-bbd0-d6dcce817717 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.817633 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 814/1654] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:10.819022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9247a9-74a3-4bed-98fc-c62b73d8c91e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.836142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 841/1655] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:10.838726 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9247a9-74a3-4bed-98fc-c62b73d8c91e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.854712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31933bbe-94be-4ec4-916d-bf98a0abb872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.855426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933bbe-94be-4ec4-916d-bf98a0abb872 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.855773 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933bbe-94be-4ec4-916d-bf98a0abb872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.856143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933bbe-94be-4ec4-916d-bf98a0abb872 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.857116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31933bbe-94be-4ec4-916d-bf98a0abb872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:10.857424 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31933bbe-94be-4ec4-916d-bf98a0abb872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.859146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31933bbe-94be-4ec4-916d-bf98a0abb872 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.892027 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 815/1656] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:10.896149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c240f5d-e91b-4491-bbd0-d6dcce817717 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.912964 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c240f5d-e91b-4491-bbd0-d6dcce817717 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.929030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa73fb7-6227-4706-a811-96e558924523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.929643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa73fb7-6227-4706-a811-96e558924523 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.929928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa73fb7-6227-4706-a811-96e558924523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.930207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa73fb7-6227-4706-a811-96e558924523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.930883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa73fb7-6227-4706-a811-96e558924523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.932995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa73fb7-6227-4706-a811-96e558924523 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.073657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 842/1657] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:10 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:11.077897 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31933bbe-94be-4ec4-916d-bf98a0abb872 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.092787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31933bbe-94be-4ec4-916d-bf98a0abb872 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.104644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:11.176007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:11.250202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18994a3-9c58-40a7-ae4b-beec2f2d4ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.252545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18994a3-9c58-40a7-ae4b-beec2f2d4ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.252844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18994a3-9c58-40a7-ae4b-beec2f2d4ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.253126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18994a3-9c58-40a7-ae4b-beec2f2d4ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.256906 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18994a3-9c58-40a7-ae4b-beec2f2d4ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.258923 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18994a3-9c58-40a7-ae4b-beec2f2d4ee6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.393215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 816/1658] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:11 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:11.398052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa73fb7-6227-4706-a811-96e558924523 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.415206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa73fb7-6227-4706-a811-96e558924523 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.432805 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602480a-3630-482b-88d7-346720fe156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.433449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602480a-3630-482b-88d7-346720fe156c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.433734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602480a-3630-482b-88d7-346720fe156c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.434012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602480a-3630-482b-88d7-346720fe156c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.434689 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602480a-3630-482b-88d7-346720fe156c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.436371 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602480a-3630-482b-88d7-346720fe156c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.463825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 843/1659] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:11.467948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18994a3-9c58-40a7-ae4b-beec2f2d4ee6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.484946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18994a3-9c58-40a7-ae4b-beec2f2d4ee6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.494309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6715e8-c923-4003-8016-2fbc03802333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.494869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6715e8-c923-4003-8016-2fbc03802333 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.495179 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6715e8-c923-4003-8016-2fbc03802333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.495456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6715e8-c923-4003-8016-2fbc03802333 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.496571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6715e8-c923-4003-8016-2fbc03802333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.499754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6715e8-c923-4003-8016-2fbc03802333 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.525548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 817/1660] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:11.526176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602480a-3630-482b-88d7-346720fe156c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.545743 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602480a-3630-482b-88d7-346720fe156c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.554046 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4e85d-6ac2-4141-9e52-b7d8c97ba126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.555092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4e85d-6ac2-4141-9e52-b7d8c97ba126 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.555534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4e85d-6ac2-4141-9e52-b7d8c97ba126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.555965 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4e85d-6ac2-4141-9e52-b7d8c97ba126 admin admin] PATH_INFO: `/v3/projects/de0d1d45b8ff4c0d9b945d452c0bb319/users/bf38b36bf6ec4536a525713ecbaaa105/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.609957 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4e85d-6ac2-4141-9e52-b7d8c97ba126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0d1d45b8ff4c0d9b945d452c0bb319, user_id=bf38b36bf6ec4536a525713ecbaaa105, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.614378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4e85d-6ac2-4141-9e52-b7d8c97ba126 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.741562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 844/1661] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:11 2022] PUT /identity/v3/projects/de0d1d45b8ff4c0d9b945d452c0bb319/users/bf38b36bf6ec4536a525713ecbaaa105/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:11.753735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe882a3d-3b7c-4cdc-aedc-d2e5eddfe655 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.753953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe882a3d-3b7c-4cdc-aedc-d2e5eddfe655 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.754230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe882a3d-3b7c-4cdc-aedc-d2e5eddfe655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.811776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-fe882a3d-3b7c-4cdc-aedc-d2e5eddfe655 None None] MFA Rules not processed for user `bf38b36bf6ec4536a525713ecbaaa105`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:11.813016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-fe882a3d-3b7c-4cdc-aedc-d2e5eddfe655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:11.974453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 818/1662] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:11.978909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4e85d-6ac2-4141-9e52-b7d8c97ba126 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.091427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4e85d-6ac2-4141-9e52-b7d8c97ba126 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.100912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6d589-1518-4639-a820-cb355447a107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.101475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d589-1518-4639-a820-cb355447a107 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.101766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d589-1518-4639-a820-cb355447a107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.102040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d589-1518-4639-a820-cb355447a107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.104210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6d589-1518-4639-a820-cb355447a107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.107152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6d589-1518-4639-a820-cb355447a107 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.288514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 845/1663] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:11 2022] POST /identity/v3/projects => generated 387 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:12.290346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe882a3d-3b7c-4cdc-aedc-d2e5eddfe655 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.306331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe882a3d-3b7c-4cdc-aedc-d2e5eddfe655 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.456790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b4e6a-9788-4d31-b3a4-e8811fde3821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.456790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b4e6a-9788-4d31-b3a4-e8811fde3821 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.456790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b4e6a-9788-4d31-b3a4-e8811fde3821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.456790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b4e6a-9788-4d31-b3a4-e8811fde3821 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.457193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b4e6a-9788-4d31-b3a4-e8811fde3821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.458413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b4e6a-9788-4d31-b3a4-e8811fde3821 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.594720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 819/1664] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:12 2022] POST /identity/v3/users => generated 294 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:12.598839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6d589-1518-4639-a820-cb355447a107 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.611978 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6d589-1518-4639-a820-cb355447a107 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.627220 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540acee-7e95-4c1b-a1ff-1aa8540a1ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.628784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540acee-7e95-4c1b-a1ff-1aa8540a1ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.628784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540acee-7e95-4c1b-a1ff-1aa8540a1ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.628784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540acee-7e95-4c1b-a1ff-1aa8540a1ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.629364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540acee-7e95-4c1b-a1ff-1aa8540a1ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.631078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540acee-7e95-4c1b-a1ff-1aa8540a1ab8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.657868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 846/1665] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:12.659203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b4e6a-9788-4d31-b3a4-e8811fde3821 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.676584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b4e6a-9788-4d31-b3a4-e8811fde3821 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.693540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfd222-5214-4e4a-bc5d-c33bb2362473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.694740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfd222-5214-4e4a-bc5d-c33bb2362473 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.695026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfd222-5214-4e4a-bc5d-c33bb2362473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.695321 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfd222-5214-4e4a-bc5d-c33bb2362473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.695997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfd222-5214-4e4a-bc5d-c33bb2362473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.702052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfd222-5214-4e4a-bc5d-c33bb2362473 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.746942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 820/1666] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:12.751270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540acee-7e95-4c1b-a1ff-1aa8540a1ab8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.776811 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540acee-7e95-4c1b-a1ff-1aa8540a1ab8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.782413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7c493-9759-44cc-b301-1242f3a12a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.783404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7c493-9759-44cc-b301-1242f3a12a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.783852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7c493-9759-44cc-b301-1242f3a12a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.784303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7c493-9759-44cc-b301-1242f3a12a5a admin admin] PATH_INFO: `/v3/projects/026b1c4b1bd049a79025823821926231/users/91e29f5a36704f09acf623e048775f80/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.820596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7c493-9759-44cc-b301-1242f3a12a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=026b1c4b1bd049a79025823821926231, user_id=91e29f5a36704f09acf623e048775f80, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.823711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7c493-9759-44cc-b301-1242f3a12a5a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.958157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:12.968166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 847/1667] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:12 2022] PUT /identity/v3/projects/026b1c4b1bd049a79025823821926231/users/91e29f5a36704f09acf623e048775f80/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:12.980159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491bdfd-2fe0-4fbd-b438-1a2cb19c96f5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.980452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491bdfd-2fe0-4fbd-b438-1a2cb19c96f5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.980732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491bdfd-2fe0-4fbd-b438-1a2cb19c96f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.995996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7c493-9759-44cc-b301-1242f3a12a5a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.997943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fea7c493-9759-44cc-b301-1242f3a12a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:13.059276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6491bdfd-2fe0-4fbd-b438-1a2cb19c96f5 None None] MFA Rules not processed for user `91e29f5a36704f09acf623e048775f80`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:13.060561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6491bdfd-2fe0-4fbd-b438-1a2cb19c96f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:13.090249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:13.161219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7c493-9759-44cc-b301-1242f3a12a5a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.182943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.183644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.183926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.184217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] PATH_INFO: `/v3/projects/f92872f1ad7841a484d31f723b8752db` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.185744 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92872f1ad7841a484d31f723b8752db)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.187760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:13.244594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 821/1668] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:13.244594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491bdfd-2fe0-4fbd-b438-1a2cb19c96f5 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.260792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491bdfd-2fe0-4fbd-b438-1a2cb19c96f5 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.265527 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9769b0-dc41-468f-af05-5dbe80a2e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.266114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9769b0-dc41-468f-af05-5dbe80a2e36e admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.266749 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9769b0-dc41-468f-af05-5dbe80a2e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.266749 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9769b0-dc41-468f-af05-5dbe80a2e36e admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.267392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9769b0-dc41-468f-af05-5dbe80a2e36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.272945 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9769b0-dc41-468f-af05-5dbe80a2e36e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:13.344952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92872f1ad7841a484d31f723b8752db', 'request_id': 'req-57fb3223-c7e6-47dd-af6a-4faf7515014f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.409011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 822/1669] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:13 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:13.420301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9769b0-dc41-468f-af05-5dbe80a2e36e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.447354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92872f1ad7841a484d31f723b8752db', 'request_id': 'req-57fb3223-c7e6-47dd-af6a-4faf7515014f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.454415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92872f1ad7841a484d31f723b8752db', 'request_id': 'req-57fb3223-c7e6-47dd-af6a-4faf7515014f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.485027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] The token cache is being invalidate because project f92872f1ad7841a484d31f723b8752db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:13.487210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.488008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-57fb3223-c7e6-47dd-af6a-4faf7515014f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.491928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 848/1670] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:12 2022] DELETE /identity/v3/projects/f92872f1ad7841a484d31f723b8752db => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:13.496749 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37607512-f160-41eb-afb9-b6b13e1057d2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.497150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37607512-f160-41eb-afb9-b6b13e1057d2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.497491 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37607512-f160-41eb-afb9-b6b13e1057d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.545243 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-37607512-f160-41eb-afb9-b6b13e1057d2 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:13.549713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-37607512-f160-41eb-afb9-b6b13e1057d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:13.576747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9769b0-dc41-468f-af05-5dbe80a2e36e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.588635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782673ad-cca1-40ef-aa03-f6384ba45326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.589289 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782673ad-cca1-40ef-aa03-f6384ba45326 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.589647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782673ad-cca1-40ef-aa03-f6384ba45326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.590000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782673ad-cca1-40ef-aa03-f6384ba45326 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.590736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782673ad-cca1-40ef-aa03-f6384ba45326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.595992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782673ad-cca1-40ef-aa03-f6384ba45326 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:13.686567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 849/1671] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:13.694874 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c84390-ff67-4c46-9c96-dcc5c798df4d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.695405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c84390-ff67-4c46-9c96-dcc5c798df4d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.695985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c84390-ff67-4c46-9c96-dcc5c798df4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.721954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-57c84390-ff67-4c46-9c96-dcc5c798df4d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:13.731641 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-57c84390-ff67-4c46-9c96-dcc5c798df4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:13.744149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 850/1672] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:13.748177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c84390-ff67-4c46-9c96-dcc5c798df4d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.759526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c84390-ff67-4c46-9c96-dcc5c798df4d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.766440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae88812-3197-44ad-8ea0-5e43cd22736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.767675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae88812-3197-44ad-8ea0-5e43cd22736f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.768624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae88812-3197-44ad-8ea0-5e43cd22736f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.769112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae88812-3197-44ad-8ea0-5e43cd22736f admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.771624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae88812-3197-44ad-8ea0-5e43cd22736f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:13.772223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae88812-3197-44ad-8ea0-5e43cd22736f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.780231 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 823/1673] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:13 2022] POST /identity/v3/users => generated 300 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:13.780370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae88812-3197-44ad-8ea0-5e43cd22736f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:13.781179 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782673ad-cca1-40ef-aa03-f6384ba45326 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.788431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-782673ad-cca1-40ef-aa03-f6384ba45326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:13.794742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 851/1674] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:13.798841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae88812-3197-44ad-8ea0-5e43cd22736f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.813586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae88812-3197-44ad-8ea0-5e43cd22736f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.816819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782673ad-cca1-40ef-aa03-f6384ba45326 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.820516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fa751-35fc-4a0c-baed-0775fea276b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.822820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa751-35fc-4a0c-baed-0775fea276b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.822820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa751-35fc-4a0c-baed-0775fea276b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.822820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa751-35fc-4a0c-baed-0775fea276b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.823545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fa751-35fc-4a0c-baed-0775fea276b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.826691 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fa751-35fc-4a0c-baed-0775fea276b2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:13.833535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aaa10b-785d-4ae0-8c04-dd87292103d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.834484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaa10b-785d-4ae0-8c04-dd87292103d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.834764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaa10b-785d-4ae0-8c04-dd87292103d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.835247 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaa10b-785d-4ae0-8c04-dd87292103d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.836110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aaa10b-785d-4ae0-8c04-dd87292103d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.838467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aaa10b-785d-4ae0-8c04-dd87292103d7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:13.866010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 824/1675] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:13.870004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aaa10b-785d-4ae0-8c04-dd87292103d7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.896740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aaa10b-785d-4ae0-8c04-dd87292103d7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.909295 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1115c59-4e6c-419f-b08a-9d6802b9bad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.910393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115c59-4e6c-419f-b08a-9d6802b9bad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.910890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115c59-4e6c-419f-b08a-9d6802b9bad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.911398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1115c59-4e6c-419f-b08a-9d6802b9bad3 admin admin] PATH_INFO: `/v3/projects/c750078824734acbaa8153bf075ca5ae/users/68005988ee314f0da69f294e7cf489a6/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.947188 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1115c59-4e6c-419f-b08a-9d6802b9bad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c750078824734acbaa8153bf075ca5ae, user_id=68005988ee314f0da69f294e7cf489a6, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.956636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 852/1676] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:13 2022] POST /identity/v3/projects => generated 405 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:13.957978 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fa751-35fc-4a0c-baed-0775fea276b2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.968791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1115c59-4e6c-419f-b08a-9d6802b9bad3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.041617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:14.070858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 825/1677] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:13 2022] PUT /identity/v3/projects/c750078824734acbaa8153bf075ca5ae/users/68005988ee314f0da69f294e7cf489a6/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:14.074613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1115c59-4e6c-419f-b08a-9d6802b9bad3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.167578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fa751-35fc-4a0c-baed-0775fea276b2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.188235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:14.210818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1115c59-4e6c-419f-b08a-9d6802b9bad3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.216366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930171f-dc8b-4bf6-9a0b-178ae0bff237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.217120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930171f-dc8b-4bf6-9a0b-178ae0bff237 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.217509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930171f-dc8b-4bf6-9a0b-178ae0bff237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.217885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930171f-dc8b-4bf6-9a0b-178ae0bff237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.218658 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930171f-dc8b-4bf6-9a0b-178ae0bff237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.223457 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930171f-dc8b-4bf6-9a0b-178ae0bff237 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.237491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 826/1678] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:14.238577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930171f-dc8b-4bf6-9a0b-178ae0bff237 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.251810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930171f-dc8b-4bf6-9a0b-178ae0bff237 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.258897 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38253e42-dc6a-46fa-b11c-e9d43a5b6e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.259764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38253e42-dc6a-46fa-b11c-e9d43a5b6e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.260150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38253e42-dc6a-46fa-b11c-e9d43a5b6e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.260532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38253e42-dc6a-46fa-b11c-e9d43a5b6e89 admin admin] PATH_INFO: `/v3/projects/c750078824734acbaa8153bf075ca5ae/users/68005988ee314f0da69f294e7cf489a6/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.262841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38253e42-dc6a-46fa-b11c-e9d43a5b6e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c750078824734acbaa8153bf075ca5ae, user_id=68005988ee314f0da69f294e7cf489a6, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.266273 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38253e42-dc6a-46fa-b11c-e9d43a5b6e89 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.296605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 827/1679] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:14 2022] PUT /identity/v3/projects/c750078824734acbaa8153bf075ca5ae/users/68005988ee314f0da69f294e7cf489a6/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:14.299607 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287211c4-7369-46b6-acef-1c52d77239b9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.301405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287211c4-7369-46b6-acef-1c52d77239b9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.301405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287211c4-7369-46b6-acef-1c52d77239b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.301818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32811fa-e8a4-42fb-9e48-65af6bc9832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.302991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32811fa-e8a4-42fb-9e48-65af6bc9832e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.303305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32811fa-e8a4-42fb-9e48-65af6bc9832e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.303581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32811fa-e8a4-42fb-9e48-65af6bc9832e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.304275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32811fa-e8a4-42fb-9e48-65af6bc9832e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.306202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32811fa-e8a4-42fb-9e48-65af6bc9832e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.337026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-287211c4-7369-46b6-acef-1c52d77239b9 None None] MFA Rules not processed for user `68005988ee314f0da69f294e7cf489a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:14.338729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-287211c4-7369-46b6-acef-1c52d77239b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.489270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 853/1680] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:13 2022] POST /identity/v3/users => generated 303 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:14.490435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32811fa-e8a4-42fb-9e48-65af6bc9832e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.499509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 828/1681] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:14.500824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32811fa-e8a4-42fb-9e48-65af6bc9832e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.513760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287211c4-7369-46b6-acef-1c52d77239b9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.523704 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-287211c4-7369-46b6-acef-1c52d77239b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.593450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287211c4-7369-46b6-acef-1c52d77239b9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.598333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb21bf-a379-4ce8-8a1e-4c9eff0630c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.599140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb21bf-a379-4ce8-8a1e-4c9eff0630c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.600246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb21bf-a379-4ce8-8a1e-4c9eff0630c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.600660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb21bf-a379-4ce8-8a1e-4c9eff0630c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.632302 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb21bf-a379-4ce8-8a1e-4c9eff0630c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.638102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb21bf-a379-4ce8-8a1e-4c9eff0630c8 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.656687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11efa-3279-415f-98be-97515db7e387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.657384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11efa-3279-415f-98be-97515db7e387 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.657735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11efa-3279-415f-98be-97515db7e387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.658017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11efa-3279-415f-98be-97515db7e387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.658687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de11efa-3279-415f-98be-97515db7e387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.660224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 829/1682] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:14.660348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de11efa-3279-415f-98be-97515db7e387 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.680699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 854/1683] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:14.684395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb21bf-a379-4ce8-8a1e-4c9eff0630c8 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.697092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb21bf-a379-4ce8-8a1e-4c9eff0630c8 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.706810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c69cce-3e9d-47a9-914c-bed8cd960a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.709770 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c69cce-3e9d-47a9-914c-bed8cd960a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.710068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c69cce-3e9d-47a9-914c-bed8cd960a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.710330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c69cce-3e9d-47a9-914c-bed8cd960a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.710994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c69cce-3e9d-47a9-914c-bed8cd960a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.719505 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c69cce-3e9d-47a9-914c-bed8cd960a31 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.744263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 830/1684] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:14.748175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11efa-3279-415f-98be-97515db7e387 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.761315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11efa-3279-415f-98be-97515db7e387 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.784005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168db06-72a3-470b-8fee-5f0e02e34762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.786029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168db06-72a3-470b-8fee-5f0e02e34762 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.786029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168db06-72a3-470b-8fee-5f0e02e34762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.786029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168db06-72a3-470b-8fee-5f0e02e34762 admin admin] PATH_INFO: `/v3/projects/60f4042431ed4f2a835d57130d556ba2/users/7c5dd46afdcf4bc78aca5c0096c2c7ba/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.827959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168db06-72a3-470b-8fee-5f0e02e34762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f4042431ed4f2a835d57130d556ba2, user_id=7c5dd46afdcf4bc78aca5c0096c2c7ba, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.832924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168db06-72a3-470b-8fee-5f0e02e34762 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.922988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 855/1685] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:14 2022] PUT /identity/v3/projects/60f4042431ed4f2a835d57130d556ba2/users/7c5dd46afdcf4bc78aca5c0096c2c7ba/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:14.928523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0a33-7e90-4ad4-94be-0b207e275310 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.929109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0a33-7e90-4ad4-94be-0b207e275310 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.929581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0a33-7e90-4ad4-94be-0b207e275310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.961634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bedd0a33-7e90-4ad4-94be-0b207e275310 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:14.963254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bedd0a33-7e90-4ad4-94be-0b207e275310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.039375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 831/1686] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:15.067092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168db06-72a3-470b-8fee-5f0e02e34762 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:15.069498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3168db06-72a3-470b-8fee-5f0e02e34762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.194780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168db06-72a3-470b-8fee-5f0e02e34762 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:15.218192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c076b91-40de-4971-bab4-38184f12a585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:15.218833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c076b91-40de-4971-bab4-38184f12a585 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.219142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c076b91-40de-4971-bab4-38184f12a585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.219421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c076b91-40de-4971-bab4-38184f12a585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.248223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c076b91-40de-4971-bab4-38184f12a585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:15.249706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c076b91-40de-4971-bab4-38184f12a585 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.269550 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 856/1687] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:15.699517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:16.110914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:16.512718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd0a33-7e90-4ad4-94be-0b207e275310 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:16.514622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bedd0a33-7e90-4ad4-94be-0b207e275310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:16.651731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd0a33-7e90-4ad4-94be-0b207e275310 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:16.660636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23befc50-1572-4513-bc8a-7747e36f3948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:16.661487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23befc50-1572-4513-bc8a-7747e36f3948 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:16.661816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23befc50-1572-4513-bc8a-7747e36f3948 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:16.665288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23befc50-1572-4513-bc8a-7747e36f3948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:16.669676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-23befc50-1572-4513-bc8a-7747e36f3948 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:16.805610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23befc50-1572-4513-bc8a-7747e36f3948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:16.807352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23befc50-1572-4513-bc8a-7747e36f3948 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:16.855644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 832/1688] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:19.728334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87162af-7bf6-4977-86c5-07d877a6d8c1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:19.731424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87162af-7bf6-4977-86c5-07d877a6d8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:19.731964 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87162af-7bf6-4977-86c5-07d877a6d8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:19.784504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e87162af-7bf6-4977-86c5-07d877a6d8c1 None None] MFA Rules not processed for user `7463c60513914e138878f6eaf0a87473`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:19.786128 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e87162af-7bf6-4977-86c5-07d877a6d8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:19.939022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 857/1689] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:19.974606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23befc50-1572-4513-bc8a-7747e36f3948 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:19.974606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-23befc50-1572-4513-bc8a-7747e36f3948 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:20.142341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23befc50-1572-4513-bc8a-7747e36f3948 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:20.158525 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35e059-a15e-42e1-b8a5-2799272de0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:20.160788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e059-a15e-42e1-b8a5-2799272de0eb service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:20.172230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e059-a15e-42e1-b8a5-2799272de0eb service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:20.172230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e059-a15e-42e1-b8a5-2799272de0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:20.206445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35e059-a15e-42e1-b8a5-2799272de0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:20.237553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35e059-a15e-42e1-b8a5-2799272de0eb service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:20.269813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 833/1690] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:21.201944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6fc95-ae0a-4a1a-b7c7-8615717b1710 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.206958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6fc95-ae0a-4a1a-b7c7-8615717b1710 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.206958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6fc95-ae0a-4a1a-b7c7-8615717b1710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.298249 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-52d6fc95-ae0a-4a1a-b7c7-8615717b1710 None None] MFA Rules not processed for user `7f4db893c9404bf7b97c5b3ac47c9a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:21.301214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-52d6fc95-ae0a-4a1a-b7c7-8615717b1710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:21.325124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adec38-d2f0-43e0-a1ef-21607588c8d2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.325720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adec38-d2f0-43e0-a1ef-21607588c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.325720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adec38-d2f0-43e0-a1ef-21607588c8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.394394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-53adec38-d2f0-43e0-a1ef-21607588c8d2 None None] MFA Rules not processed for user `c55dbc02c6bc4b459a3491283c5cad48`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:21.396989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-53adec38-d2f0-43e0-a1ef-21607588c8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:21.423620 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:21.441665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 858/1691] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:21.442969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d49d-dccd-4c9e-9ab4-1300ae71b28c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.443295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d49d-dccd-4c9e-9ab4-1300ae71b28c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.443565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d49d-dccd-4c9e-9ab4-1300ae71b28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.507525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7552d49d-dccd-4c9e-9ab4-1300ae71b28c None None] MFA Rules not processed for user `7c5dd46afdcf4bc78aca5c0096c2c7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:21.522436 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7552d49d-dccd-4c9e-9ab4-1300ae71b28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:21.525471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 834/1692] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:21.527277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bfca5-1161-4373-95f4-b207dde1344f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.527866 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bfca5-1161-4373-95f4-b207dde1344f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.528389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bfca5-1161-4373-95f4-b207dde1344f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.553221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:21.554568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d85bfca5-1161-4373-95f4-b207dde1344f None None] MFA Rules not processed for user `7f4db893c9404bf7b97c5b3ac47c9a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:21.555874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d85bfca5-1161-4373-95f4-b207dde1344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:21.566025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 835/1693] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:21.579463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25356b10-8f3d-429f-b049-728e35ecdfda None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.579760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25356b10-8f3d-429f-b049-728e35ecdfda None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.580087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25356b10-8f3d-429f-b049-728e35ecdfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.623201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-25356b10-8f3d-429f-b049-728e35ecdfda None None] MFA Rules not processed for user `c55dbc02c6bc4b459a3491283c5cad48`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:21.626595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-25356b10-8f3d-429f-b049-728e35ecdfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:21.644475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 836/1694] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:21.645330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25356b10-8f3d-429f-b049-728e35ecdfda None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:21.647578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-25356b10-8f3d-429f-b049-728e35ecdfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:21.680009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25356b10-8f3d-429f-b049-728e35ecdfda None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:21.688136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb3f15-c116-49f1-b043-5e74884631a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:21.692072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 859/1695] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:21 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:21.693141 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d49d-dccd-4c9e-9ab4-1300ae71b28c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:21.696296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb3f15-c116-49f1-b043-5e74884631a8 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.696594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb3f15-c116-49f1-b043-5e74884631a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.696878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb3f15-c116-49f1-b043-5e74884631a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.714842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb3f15-c116-49f1-b043-5e74884631a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:21.717056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb3f15-c116-49f1-b043-5e74884631a8 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:21.721723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d49d-dccd-4c9e-9ab4-1300ae71b28c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:21.735539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd2397-1c56-44df-a0ea-37728e3f2c49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:21.736330 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd2397-1c56-44df-a0ea-37728e3f2c49 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.736719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd2397-1c56-44df-a0ea-37728e3f2c49 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.737104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd2397-1c56-44df-a0ea-37728e3f2c49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.755559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd2397-1c56-44df-a0ea-37728e3f2c49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:21.757805 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd2397-1c56-44df-a0ea-37728e3f2c49 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:21.762051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 837/1696] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:21.768581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb3f15-c116-49f1-b043-5e74884631a8 service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:21.775699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 860/1697] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:21.788958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb3f15-c116-49f1-b043-5e74884631a8 service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:21.796582 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae944229-85ad-43f7-bae7-a3c756e9ad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:21.797367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae944229-85ad-43f7-bae7-a3c756e9ad2a admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.797760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae944229-85ad-43f7-bae7-a3c756e9ad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.798152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae944229-85ad-43f7-bae7-a3c756e9ad2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.798911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae944229-85ad-43f7-bae7-a3c756e9ad2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:21.801177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae944229-85ad-43f7-bae7-a3c756e9ad2a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:21.959761 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 838/1698] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:21 2022] POST /identity/v3/projects => generated 405 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:21.962401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd2397-1c56-44df-a0ea-37728e3f2c49 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:21.982909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd2397-1c56-44df-a0ea-37728e3f2c49 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:22.075109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11aaef-2dfe-4ee7-8a22-375e61cf29b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:22.075930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11aaef-2dfe-4ee7-8a22-375e61cf29b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.076322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11aaef-2dfe-4ee7-8a22-375e61cf29b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.076777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11aaef-2dfe-4ee7-8a22-375e61cf29b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.077531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11aaef-2dfe-4ee7-8a22-375e61cf29b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:22.080358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11aaef-2dfe-4ee7-8a22-375e61cf29b8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:22.219801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 861/1699] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:21 2022] POST /identity/v3/users => generated 309 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:22.222972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae944229-85ad-43f7-bae7-a3c756e9ad2a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:22.252425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae944229-85ad-43f7-bae7-a3c756e9ad2a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:22.277252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c722495-4fed-4cf9-91c9-77afd2be7c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:22.278165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722495-4fed-4cf9-91c9-77afd2be7c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.281087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722495-4fed-4cf9-91c9-77afd2be7c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.281087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722495-4fed-4cf9-91c9-77afd2be7c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.281087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c722495-4fed-4cf9-91c9-77afd2be7c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:22.281390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c722495-4fed-4cf9-91c9-77afd2be7c49 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:22.317496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11aaef-2dfe-4ee7-8a22-375e61cf29b8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:22.324857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 839/1700] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:22.337770 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11aaef-2dfe-4ee7-8a22-375e61cf29b8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:22.354680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5dca-8c2c-4b54-b9b2-c26ccb3e8052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:22.355631 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5dca-8c2c-4b54-b9b2-c26ccb3e8052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.356042 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5dca-8c2c-4b54-b9b2-c26ccb3e8052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.356387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5dca-8c2c-4b54-b9b2-c26ccb3e8052 admin admin] PATH_INFO: `/v3/projects/807f5a90985b47d2b3e1d1031d458fcd/users/a389641605c240a4bf87d48cd59e1662/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.367575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cf71-281a-4796-a5fc-5c9dd9f4d384 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.368090 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cf71-281a-4796-a5fc-5c9dd9f4d384 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.368162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cf71-281a-4796-a5fc-5c9dd9f4d384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.417854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da5dca-8c2c-4b54-b9b2-c26ccb3e8052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807f5a90985b47d2b3e1d1031d458fcd, user_id=a389641605c240a4bf87d48cd59e1662, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:22.432409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da5dca-8c2c-4b54-b9b2-c26ccb3e8052 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:22.453481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5867cf71-281a-4796-a5fc-5c9dd9f4d384 None None] MFA Rules not processed for user `f844fed122764361a93664842d60070e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:22.454726 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5867cf71-281a-4796-a5fc-5c9dd9f4d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:22.556917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 862/1701] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:22 2022] PUT /identity/v3/projects/807f5a90985b47d2b3e1d1031d458fcd/users/a389641605c240a4bf87d48cd59e1662/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:22.562565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5dca-8c2c-4b54-b9b2-c26ccb3e8052 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:22.679333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 840/1702] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:22.721625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5dca-8c2c-4b54-b9b2-c26ccb3e8052 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:22.738702 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d7ef8-f159-4cd9-a995-2af19011f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:22.740178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7ef8-f159-4cd9-a995-2af19011f953 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.740624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7ef8-f159-4cd9-a995-2af19011f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.741035 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7ef8-f159-4cd9-a995-2af19011f953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.741850 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d7ef8-f159-4cd9-a995-2af19011f953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:22.745863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d7ef8-f159-4cd9-a995-2af19011f953 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:22.754061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:22.775346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 863/1703] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:22.776744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867cf71-281a-4796-a5fc-5c9dd9f4d384 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:22.792239 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867cf71-281a-4796-a5fc-5c9dd9f4d384 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:22.800173 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4e372-f470-4ee1-a0a9-2178aee8952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:22.801477 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4e372-f470-4ee1-a0a9-2178aee8952a admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.801975 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4e372-f470-4ee1-a0a9-2178aee8952a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.803106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4e372-f470-4ee1-a0a9-2178aee8952a admin admin] PATH_INFO: `/v3/projects/807f5a90985b47d2b3e1d1031d458fcd/users/a389641605c240a4bf87d48cd59e1662/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.805476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4e372-f470-4ee1-a0a9-2178aee8952a admin admin] RBAC: Authorizing `identity:create_grant(project_id=807f5a90985b47d2b3e1d1031d458fcd, user_id=a389641605c240a4bf87d48cd59e1662, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:22.808598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4e372-f470-4ee1-a0a9-2178aee8952a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:22.825827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 841/1704] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:22 2022] PUT /identity/v3/projects/807f5a90985b47d2b3e1d1031d458fcd/users/a389641605c240a4bf87d48cd59e1662/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:22.870601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d49b10-b6cf-41a4-a4a4-4b68d99e69da None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.870902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d49b10-b6cf-41a4-a4a4-4b68d99e69da None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.871217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d49b10-b6cf-41a4-a4a4-4b68d99e69da None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.872872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 864/1705] 10.222.0.88 () {54 vars in 912 bytes} [Wed Aug 24 03:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:22.884127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf79c9-92c0-4356-87dc-1a89148e7519 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.884448 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf79c9-92c0-4356-87dc-1a89148e7519 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.884732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf79c9-92c0-4356-87dc-1a89148e7519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.911354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe8134-db9b-4556-845f-d3e48b4241ba None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.911354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe8134-db9b-4556-845f-d3e48b4241ba None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.911354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe8134-db9b-4556-845f-d3e48b4241ba None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.911354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 865/1706] 10.222.0.88 () {54 vars in 912 bytes} [Wed Aug 24 03:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:22.916723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568dcb6-95e8-4147-9483-153349402d5e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.917006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568dcb6-95e8-4147-9483-153349402d5e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.917282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568dcb6-95e8-4147-9483-153349402d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.974726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f568dcb6-95e8-4147-9483-153349402d5e None None] MFA Rules not processed for user `b4ab7a3b191e4a0b84b396cafa8a9ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:22.977717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f568dcb6-95e8-4147-9483-153349402d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:22.991884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-42bf79c9-92c0-4356-87dc-1a89148e7519 None None] MFA Rules not processed for user `b4ab7a3b191e4a0b84b396cafa8a9ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:22.995645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-42bf79c9-92c0-4356-87dc-1a89148e7519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:23.028366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:23.094963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 866/1707] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:23.103616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568dcb6-95e8-4147-9483-153349402d5e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:23.107581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f568dcb6-95e8-4147-9483-153349402d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:23.135768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 842/1708] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:23.135851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568dcb6-95e8-4147-9483-153349402d5e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:23.135851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a3d72-177d-47d7-8c5b-e7dbea227f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:23.135851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a3d72-177d-47d7-8c5b-e7dbea227f50 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:23.135851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a3d72-177d-47d7-8c5b-e7dbea227f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:23.136121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a3d72-177d-47d7-8c5b-e7dbea227f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:23.139432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf79c9-92c0-4356-87dc-1a89148e7519 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:23.153893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf79c9-92c0-4356-87dc-1a89148e7519 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:23.165550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ac0e-7d10-4a73-a08f-69e52b5cfb95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:23.166292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ac0e-7d10-4a73-a08f-69e52b5cfb95 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:23.166580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ac0e-7d10-4a73-a08f-69e52b5cfb95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:23.166854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ac0e-7d10-4a73-a08f-69e52b5cfb95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:23.168452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a3d72-177d-47d7-8c5b-e7dbea227f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:23.171391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a3d72-177d-47d7-8c5b-e7dbea227f50 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:23.186572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039ac0e-7d10-4a73-a08f-69e52b5cfb95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:23.191849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039ac0e-7d10-4a73-a08f-69e52b5cfb95 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:23.195470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 867/1709] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:23.219321 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 843/1710] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:23.991221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dee34d-a5f2-40f9-ad7d-8e67229c1e8c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:23.993630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dee34d-a5f2-40f9-ad7d-8e67229c1e8c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:23.993630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dee34d-a5f2-40f9-ad7d-8e67229c1e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.080588 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-92dee34d-a5f2-40f9-ad7d-8e67229c1e8c None None] MFA Rules not processed for user `80d12d339c7e4908bb3fd773db3060cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:24.089141 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-92dee34d-a5f2-40f9-ad7d-8e67229c1e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:24.196385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ac0e-7d10-4a73-a08f-69e52b5cfb95 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:24.365380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 868/1711] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:24.427629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de074b20-d78d-4c17-bc52-332c05c582ab None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.428191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de074b20-d78d-4c17-bc52-332c05c582ab None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.428630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de074b20-d78d-4c17-bc52-332c05c582ab None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.430502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 869/1712] 10.222.0.88 () {54 vars in 961 bytes} [Wed Aug 24 03:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:24.451581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07cc6-6078-44bb-b09c-9b7676141d3c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.452296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07cc6-6078-44bb-b09c-9b7676141d3c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.452883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07cc6-6078-44bb-b09c-9b7676141d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.544993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-70c07cc6-6078-44bb-b09c-9b7676141d3c None None] MFA Rules not processed for user `e686e974721345eba4de46cde2edaf34`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:24.546649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70c07cc6-6078-44bb-b09c-9b7676141d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:24.616821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ac0e-7d10-4a73-a08f-69e52b5cfb95 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:24.641038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74855ce-6406-4127-b4de-d5ac5daf65bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:24.641975 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74855ce-6406-4127-b4de-d5ac5daf65bb service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.642261 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74855ce-6406-4127-b4de-d5ac5daf65bb service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.642515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74855ce-6406-4127-b4de-d5ac5daf65bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.771387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 870/1713] 10.222.0.88 () {58 vars in 1058 bytes} [Wed Aug 24 03:48:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:24.772396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c07cc6-6078-44bb-b09c-9b7676141d3c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:24.775785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-70c07cc6-6078-44bb-b09c-9b7676141d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:24.813745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74855ce-6406-4127-b4de-d5ac5daf65bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:24.815000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c07cc6-6078-44bb-b09c-9b7676141d3c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:24.816614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74855ce-6406-4127-b4de-d5ac5daf65bb service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:24.828228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff846bd0-ea86-4c15-97da-91a7d999c1bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:24.830187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846bd0-ea86-4c15-97da-91a7d999c1bd service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.830480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846bd0-ea86-4c15-97da-91a7d999c1bd service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.831727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846bd0-ea86-4c15-97da-91a7d999c1bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.838903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ff846bd0-ea86-4c15-97da-91a7d999c1bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:24.848553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 844/1714] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:24.848553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973b5dd-d441-46e7-a2cb-856003476f37 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.848553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973b5dd-d441-46e7-a2cb-856003476f37 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.848553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973b5dd-d441-46e7-a2cb-856003476f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.893536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff846bd0-ea86-4c15-97da-91a7d999c1bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:24.897421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e973b5dd-d441-46e7-a2cb-856003476f37 None None] MFA Rules not processed for user `7f4db893c9404bf7b97c5b3ac47c9a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:24.897561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff846bd0-ea86-4c15-97da-91a7d999c1bd service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:24.897650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e973b5dd-d441-46e7-a2cb-856003476f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:24.917003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:24.931730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 871/1715] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:24.937775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff846bd0-ea86-4c15-97da-91a7d999c1bd service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:24.963359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff846bd0-ea86-4c15-97da-91a7d999c1bd service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:24.995257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a10ad-83ec-4279-aff6-8f16eb1a5a8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:24.997025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a10ad-83ec-4279-aff6-8f16eb1a5a8b service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.997316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a10ad-83ec-4279-aff6-8f16eb1a5a8b service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.998698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a10ad-83ec-4279-aff6-8f16eb1a5a8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:25.023501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a10ad-83ec-4279-aff6-8f16eb1a5a8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:25.028903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a10ad-83ec-4279-aff6-8f16eb1a5a8b service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:25.050513 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 845/1716] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:25.052950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973b5dd-d441-46e7-a2cb-856003476f37 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:25.064200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 872/1717] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:25.068394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:25.068524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a10ad-83ec-4279-aff6-8f16eb1a5a8b service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:25.097508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a10ad-83ec-4279-aff6-8f16eb1a5a8b service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:25.116812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ce927-da8b-4ab0-8404-921d29081e2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:25.117456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce927-da8b-4ab0-8404-921d29081e2f service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:25.119258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce927-da8b-4ab0-8404-921d29081e2f service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:25.119635 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce927-da8b-4ab0-8404-921d29081e2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:25.159539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ce927-da8b-4ab0-8404-921d29081e2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:25.166574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ce927-da8b-4ab0-8404-921d29081e2f service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:25.197977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 873/1718] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:25.264359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973b5dd-d441-46e7-a2cb-856003476f37 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:25.283083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f8977-9104-4ca5-b308-f6258e99af17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:25.286105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8977-9104-4ca5-b308-f6258e99af17 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:25.290128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8977-9104-4ca5-b308-f6258e99af17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:25.290436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8977-9104-4ca5-b308-f6258e99af17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:25.295547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ba5f8977-9104-4ca5-b308-f6258e99af17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:25.471887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f8977-9104-4ca5-b308-f6258e99af17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:25.473636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f8977-9104-4ca5-b308-f6258e99af17 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:25.510740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 846/1719] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:25.995614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb39b-2cc6-4aaa-adb9-1fb556ade0c3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:25.996148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb39b-2cc6-4aaa-adb9-1fb556ade0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:25.996148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bb39b-2cc6-4aaa-adb9-1fb556ade0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:26.057064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-674bb39b-2cc6-4aaa-adb9-1fb556ade0c3 None None] MFA Rules not processed for user `a389641605c240a4bf87d48cd59e1662`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:26.060855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-674bb39b-2cc6-4aaa-adb9-1fb556ade0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:26.252675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 874/1720] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:25 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:28.136124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dde3c-f6a8-4f8f-ada8-eb4918b275ff None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:28.136598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dde3c-f6a8-4f8f-ada8-eb4918b275ff None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:28.136744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dde3c-f6a8-4f8f-ada8-eb4918b275ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:28.217930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a51dde3c-f6a8-4f8f-ada8-eb4918b275ff None None] MFA Rules not processed for user `7463c60513914e138878f6eaf0a87473`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:28.221584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a51dde3c-f6a8-4f8f-ada8-eb4918b275ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:28.383735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a7625-3874-4f1b-99b8-72d9dc5c1765 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:28.384790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a7625-3874-4f1b-99b8-72d9dc5c1765 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:28.385388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a7625-3874-4f1b-99b8-72d9dc5c1765 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:28.389171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 875/1721] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:48:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:28.424032 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549bb62-995d-45f2-926d-5330d673f267 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:28.424498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549bb62-995d-45f2-926d-5330d673f267 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:28.424784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549bb62-995d-45f2-926d-5330d673f267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:28.479641 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2549bb62-995d-45f2-926d-5330d673f267 None None] MFA Rules not processed for user `e686e974721345eba4de46cde2edaf34`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:28.510806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2549bb62-995d-45f2-926d-5330d673f267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:28.511472 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 847/1722] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:28.530711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 876/1723] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:48:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:28.543440 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dde3c-f6a8-4f8f-ada8-eb4918b275ff None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:28.561965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dde3c-f6a8-4f8f-ada8-eb4918b275ff None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:28.569189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38152af5-f145-4dcb-b8d5-091d345bb84b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:28.570810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152af5-f145-4dcb-b8d5-091d345bb84b service placement] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:28.571324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152af5-f145-4dcb-b8d5-091d345bb84b service placement] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:28.571914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152af5-f145-4dcb-b8d5-091d345bb84b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:28.592011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38152af5-f145-4dcb-b8d5-091d345bb84b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:28.599382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38152af5-f145-4dcb-b8d5-091d345bb84b service placement] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:28.675867 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 848/1724] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:30.609019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549bb62-995d-45f2-926d-5330d673f267 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:30.612104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2549bb62-995d-45f2-926d-5330d673f267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:30.758619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549bb62-995d-45f2-926d-5330d673f267 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:30.764564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:30.766285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:30.766675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:30.767072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] PATH_INFO: `/v3/users/c9ebf7ccd920438586529a86ddbf42eb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:30.769066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ebf7ccd920438586529a86ddbf42eb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:30.772170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:31.099737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fcf5f-2bf5-476e-84ef-24c3d975bbf0 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.100343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fcf5f-2bf5-476e-84ef-24c3d975bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.101108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fcf5f-2bf5-476e-84ef-24c3d975bbf0 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.103459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 849/1725] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:48:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:31.123128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5df54-1e1e-403d-b2fa-2ee38068dd79 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.124105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5df54-1e1e-403d-b2fa-2ee38068dd79 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.124521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5df54-1e1e-403d-b2fa-2ee38068dd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.172362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e5b5df54-1e1e-403d-b2fa-2ee38068dd79 None None] MFA Rules not processed for user `e686e974721345eba4de46cde2edaf34`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:31.175891 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e5b5df54-1e1e-403d-b2fa-2ee38068dd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:31.177801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ebf7ccd920438586529a86ddbf42eb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:31.181008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ebf7ccd920438586529a86ddbf42eb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:31.188004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ebf7ccd920438586529a86ddbf42eb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:31.211316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 850/1726] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:48:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:31.271101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5df54-1e1e-403d-b2fa-2ee38068dd79 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:31.273636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e5b5df54-1e1e-403d-b2fa-2ee38068dd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:31.296317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5df54-1e1e-403d-b2fa-2ee38068dd79 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:31.303923 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782fb5c-4627-4b75-857d-a22fb6d7c07b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:31.313474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782fb5c-4627-4b75-857d-a22fb6d7c07b service placement] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.313474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782fb5c-4627-4b75-857d-a22fb6d7c07b service placement] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.313474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782fb5c-4627-4b75-857d-a22fb6d7c07b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.320508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782fb5c-4627-4b75-857d-a22fb6d7c07b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:31.324820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782fb5c-4627-4b75-857d-a22fb6d7c07b service placement] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:31.359714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ebf7ccd920438586529a86ddbf42eb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:31.362262 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 851/1727] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:31.374332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:31.407001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ebf7ccd920438586529a86ddbf42eb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:31.491410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 877/1728] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:30 2022] DELETE /identity/v3/users/c9ebf7ccd920438586529a86ddbf42eb => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:31.497752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af467f-b3ba-4245-924f-03d2f8c9793d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.498041 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af467f-b3ba-4245-924f-03d2f8c9793d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.498493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af467f-b3ba-4245-924f-03d2f8c9793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.522467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-56af467f-b3ba-4245-924f-03d2f8c9793d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:31.524353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-56af467f-b3ba-4245-924f-03d2f8c9793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:31.541507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:31.554053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:31.556428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:31.649225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 852/1729] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:31.685794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22eb246-1115-462e-b366-2126927c05dc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:31.692795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:31.693858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.694390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.694816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] PATH_INFO: `/v3/users/7c5dd46afdcf4bc78aca5c0096c2c7ba` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.696450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c5dd46afdcf4bc78aca5c0096c2c7ba)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:31.698715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:31.760175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af467f-b3ba-4245-924f-03d2f8c9793d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:31.762270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-56af467f-b3ba-4245-924f-03d2f8c9793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:31.925932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af467f-b3ba-4245-924f-03d2f8c9793d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:31.938128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d94f5-a4c7-421c-8a3d-dfff72fa9799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:31.950147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d94f5-a4c7-421c-8a3d-dfff72fa9799 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.950523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d94f5-a4c7-421c-8a3d-dfff72fa9799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.951100 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d94f5-a4c7-421c-8a3d-dfff72fa9799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.969795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c5dd46afdcf4bc78aca5c0096c2c7ba'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:31.970502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c5dd46afdcf4bc78aca5c0096c2c7ba'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:31.971528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c5dd46afdcf4bc78aca5c0096c2c7ba'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:31.989650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d94f5-a4c7-421c-8a3d-dfff72fa9799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:31.998078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d94f5-a4c7-421c-8a3d-dfff72fa9799 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:32.020412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 853/1730] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:32.024964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09cf3-fdb2-4fff-8adc-e3806c2c60af None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:32.025267 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09cf3-fdb2-4fff-8adc-e3806c2c60af None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:32.025580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09cf3-fdb2-4fff-8adc-e3806c2c60af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.098151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c5dd46afdcf4bc78aca5c0096c2c7ba'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:32.136400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c5dd46afdcf4bc78aca5c0096c2c7ba'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:32.158923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 878/1731] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:31 2022] DELETE /identity/v3/users/7c5dd46afdcf4bc78aca5c0096c2c7ba => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:32.175838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c8b09cf3-fdb2-4fff-8adc-e3806c2c60af None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:32.178756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c8b09cf3-fdb2-4fff-8adc-e3806c2c60af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:32.288996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 854/1732] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:32.606211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:32.607761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:32.707375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb103f-ba38-4cfc-9d0d-4703e3e497af admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:32.742931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:32.743686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:32.743975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:32.744252 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] PATH_INFO: `/v3/users/bf38b36bf6ec4536a525713ecbaaa105` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.745812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf38b36bf6ec4536a525713ecbaaa105)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:32.747898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:32.794767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09cf3-fdb2-4fff-8adc-e3806c2c60af None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:32.796806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c8b09cf3-fdb2-4fff-8adc-e3806c2c60af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:32.860419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:32.930373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09cf3-fdb2-4fff-8adc-e3806c2c60af None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:32.936962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efead09-1aca-4cfc-adae-6d20549042c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:32.937529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efead09-1aca-4cfc-adae-6d20549042c6 service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:32.937815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efead09-1aca-4cfc-adae-6d20549042c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:32.938092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efead09-1aca-4cfc-adae-6d20549042c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.948345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efead09-1aca-4cfc-adae-6d20549042c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:32.950739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efead09-1aca-4cfc-adae-6d20549042c6 service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:32.962219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 855/1733] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:48:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:48:33.062432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf38b36bf6ec4536a525713ecbaaa105'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:33.063188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf38b36bf6ec4536a525713ecbaaa105'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:33.064009 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf38b36bf6ec4536a525713ecbaaa105'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:33.157291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf38b36bf6ec4536a525713ecbaaa105'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:33.213838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf38b36bf6ec4536a525713ecbaaa105'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:33.277552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 879/1734] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:32 2022] DELETE /identity/v3/users/bf38b36bf6ec4536a525713ecbaaa105 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:33.282189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600421f-7a1f-4400-b58a-1495863d644d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:33.282769 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600421f-7a1f-4400-b58a-1495863d644d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:33.283254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600421f-7a1f-4400-b58a-1495863d644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:33.331683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8600421f-7a1f-4400-b58a-1495863d644d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:33.334315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8600421f-7a1f-4400-b58a-1495863d644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:33.595845 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 856/1735] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:34.041880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:34.043481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:34.317089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4b62e-7d12-4f1d-ab4d-02e37585347b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:34.346092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28330b39-b630-41bc-ab8e-9a49fffa5e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:34.346661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28330b39-b630-41bc-ab8e-9a49fffa5e22 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:34.347077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28330b39-b630-41bc-ab8e-9a49fffa5e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:34.347433 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28330b39-b630-41bc-ab8e-9a49fffa5e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:34.370045 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28330b39-b630-41bc-ab8e-9a49fffa5e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:34.372246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28330b39-b630-41bc-ab8e-9a49fffa5e22 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:34.400029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 880/1736] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:34.477723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600421f-7a1f-4400-b58a-1495863d644d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:34.479242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8600421f-7a1f-4400-b58a-1495863d644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:34.507322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600421f-7a1f-4400-b58a-1495863d644d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:34.528150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:34.529247 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:34.529750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:34.530248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] PATH_INFO: `/v3/projects/60f4042431ed4f2a835d57130d556ba2` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:34.531750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f4042431ed4f2a835d57130d556ba2)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:34.534002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:34.797358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f4042431ed4f2a835d57130d556ba2', 'request_id': 'req-435d5a85-e470-402e-b01f-b62f15ebb420'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:34.815825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f4042431ed4f2a835d57130d556ba2', 'request_id': 'req-435d5a85-e470-402e-b01f-b62f15ebb420'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:34.966621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f4042431ed4f2a835d57130d556ba2', 'request_id': 'req-435d5a85-e470-402e-b01f-b62f15ebb420'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:34.988682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] The token cache is being invalidate because project 60f4042431ed4f2a835d57130d556ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:34.989212 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:34.990167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-435d5a85-e470-402e-b01f-b62f15ebb420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:34.992517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 857/1737] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:34 2022] DELETE /identity/v3/projects/60f4042431ed4f2a835d57130d556ba2 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:34.996583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28330b39-b630-41bc-ab8e-9a49fffa5e22 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:35.010195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28330b39-b630-41bc-ab8e-9a49fffa5e22 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:35.089924 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85ee4-9fe4-401b-81f9-d20b34531606 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:35.090202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85ee4-9fe4-401b-81f9-d20b34531606 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:35.090482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85ee4-9fe4-401b-81f9-d20b34531606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:35.103829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:35.105005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:35.105176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:35.105499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] PATH_INFO: `/v3/users/a389641605c240a4bf87d48cd59e1662` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:35.107001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a389641605c240a4bf87d48cd59e1662)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:35.110508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:35.114826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-67f85ee4-9fe4-401b-81f9-d20b34531606 None None] MFA Rules not processed for user `80d12d339c7e4908bb3fd773db3060cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:35.116271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-67f85ee4-9fe4-401b-81f9-d20b34531606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:35.202162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.332602 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 858/1738] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:35.339315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cbc4c-1c18-4c6e-84fa-b28c4cbf46a9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:35.341305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cbc4c-1c18-4c6e-84fa-b28c4cbf46a9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:35.343389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cbc4c-1c18-4c6e-84fa-b28c4cbf46a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:35.373665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.436085 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-909cbc4c-1c18-4c6e-84fa-b28c4cbf46a9 None None] MFA Rules not processed for user `f844fed122764361a93664842d60070e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:35.450741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-909cbc4c-1c18-4c6e-84fa-b28c4cbf46a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:35.568739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 859/1739] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:35.576835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cbc4c-1c18-4c6e-84fa-b28c4cbf46a9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:35.578563 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-909cbc4c-1c18-4c6e-84fa-b28c4cbf46a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:35.597489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cbc4c-1c18-4c6e-84fa-b28c4cbf46a9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:35.606785 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:35.608128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:35.609310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:35.610195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] PATH_INFO: `/v3/projects/01b133cc766c42c4bab25a28d94998cd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:35.612706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b133cc766c42c4bab25a28d94998cd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:35.616579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:35.654854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a389641605c240a4bf87d48cd59e1662'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:35.655772 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a389641605c240a4bf87d48cd59e1662'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:35.662989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a389641605c240a4bf87d48cd59e1662'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:35.875722 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a389641605c240a4bf87d48cd59e1662'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:35.918804 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a389641605c240a4bf87d48cd59e1662'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:35.936647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b133cc766c42c4bab25a28d94998cd', 'request_id': 'req-f0563d8c-c36d-422a-8e1a-885e544ac988'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:35.969455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 881/1740] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:34 2022] DELETE /identity/v3/users/a389641605c240a4bf87d48cd59e1662 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:35.969727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b133cc766c42c4bab25a28d94998cd', 'request_id': 'req-f0563d8c-c36d-422a-8e1a-885e544ac988'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:36.195780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b133cc766c42c4bab25a28d94998cd', 'request_id': 'req-f0563d8c-c36d-422a-8e1a-885e544ac988'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:36.217118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] The token cache is being invalidate because project 01b133cc766c42c4bab25a28d94998cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:36.217421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:36.230928 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f0563d8c-c36d-422a-8e1a-885e544ac988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:36.242573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 860/1741] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:35 2022] DELETE /identity/v3/projects/01b133cc766c42c4bab25a28d94998cd => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:36.248823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:36.251718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:36.396202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96be7a-cedf-4d83-8a2d-d72a66131d3a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:36.396660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96be7a-cedf-4d83-8a2d-d72a66131d3a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:36.397079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96be7a-cedf-4d83-8a2d-d72a66131d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:36.493836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4e96be7a-cedf-4d83-8a2d-d72a66131d3a None None] MFA Rules not processed for user `b4ab7a3b191e4a0b84b396cafa8a9ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:36.499406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4e96be7a-cedf-4d83-8a2d-d72a66131d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:36.564945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85bc7f-b28e-47df-aab3-626aa2dbfc17 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:36.596420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da14fb-1d01-41a2-b1a7-76d0ae6d68c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:36.600218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da14fb-1d01-41a2-b1a7-76d0ae6d68c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:36.601508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da14fb-1d01-41a2-b1a7-76d0ae6d68c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:36.602654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da14fb-1d01-41a2-b1a7-76d0ae6d68c8 admin admin] PATH_INFO: `/v3/users/51b79b9b1ed34f50a262e23f4b5d568c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:36.606817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da14fb-1d01-41a2-b1a7-76d0ae6d68c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b79b9b1ed34f50a262e23f4b5d568c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:36.617296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da14fb-1d01-41a2-b1a7-76d0ae6d68c8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:36.712392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 861/1742] 10.222.0.93 () {58 vars in 1015 bytes} [Wed Aug 24 03:48:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:36.771526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96be7a-cedf-4d83-8a2d-d72a66131d3a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:36.774162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4e96be7a-cedf-4d83-8a2d-d72a66131d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:36.810905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96be7a-cedf-4d83-8a2d-d72a66131d3a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:36.826055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b89255-e635-47a4-aacf-35bf121237e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:36.827219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b89255-e635-47a4-aacf-35bf121237e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:36.828168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b89255-e635-47a4-aacf-35bf121237e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:36.828657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b89255-e635-47a4-aacf-35bf121237e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:36.843119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b89255-e635-47a4-aacf-35bf121237e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:36.846223 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b89255-e635-47a4-aacf-35bf121237e0 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:36.883521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 862/1743] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:36.906025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b89255-e635-47a4-aacf-35bf121237e0 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:36.908927 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a9b89255-e635-47a4-aacf-35bf121237e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:36.948245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b89255-e635-47a4-aacf-35bf121237e0 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:36.964197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-16da14fb-1d01-41a2-b1a7-76d0ae6d68c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b79b9b1ed34f50a262e23f4b5d568c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:36.968903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-16da14fb-1d01-41a2-b1a7-76d0ae6d68c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b79b9b1ed34f50a262e23f4b5d568c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:36.970167 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-16da14fb-1d01-41a2-b1a7-76d0ae6d68c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b79b9b1ed34f50a262e23f4b5d568c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:36.988540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9777b-9411-44d2-af64-79b7d57a4e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:36.988540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9777b-9411-44d2-af64-79b7d57a4e22 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:36.988540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9777b-9411-44d2-af64-79b7d57a4e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:36.988813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9777b-9411-44d2-af64-79b7d57a4e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:36.992885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-eff9777b-9411-44d2-af64-79b7d57a4e22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:37.052291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9777b-9411-44d2-af64-79b7d57a4e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:37.060452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9777b-9411-44d2-af64-79b7d57a4e22 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:37.087637 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 863/1744] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:37.089065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9777b-9411-44d2-af64-79b7d57a4e22 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:37.092300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-eff9777b-9411-44d2-af64-79b7d57a4e22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:37.165212 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9777b-9411-44d2-af64-79b7d57a4e22 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:37.180884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:37.181145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:37.181437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:37.182035 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] PATH_INFO: `/v3/projects/807f5a90985b47d2b3e1d1031d458fcd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:37.184934 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] RBAC: Authorizing `identity:delete_project(project_id=807f5a90985b47d2b3e1d1031d458fcd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:37.187011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:37.297275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-16da14fb-1d01-41a2-b1a7-76d0ae6d68c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b79b9b1ed34f50a262e23f4b5d568c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.336719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-16da14fb-1d01-41a2-b1a7-76d0ae6d68c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b79b9b1ed34f50a262e23f4b5d568c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.383859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 882/1745] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:36 2022] DELETE /identity/v3/users/51b79b9b1ed34f50a262e23f4b5d568c => generated 0 bytes in 1131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:37.470689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807f5a90985b47d2b3e1d1031d458fcd', 'request_id': 'req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.487921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807f5a90985b47d2b3e1d1031d458fcd', 'request_id': 'req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.756587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807f5a90985b47d2b3e1d1031d458fcd', 'request_id': 'req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.778661 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] The token cache is being invalidate because project 807f5a90985b47d2b3e1d1031d458fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:37.778960 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.782717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cca2bcad-2b3f-4a67-8c6d-49f41c12581c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.793792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 864/1746] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:37 2022] DELETE /identity/v3/projects/807f5a90985b47d2b3e1d1031d458fcd => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:37.795569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1eaa-9b05-42be-9a17-b3e951a25176 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:37.795861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1eaa-9b05-42be-9a17-b3e951a25176 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:37.797284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af1eaa-9b05-42be-9a17-b3e951a25176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:37.901407 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-73af1eaa-9b05-42be-9a17-b3e951a25176 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:37.911896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-73af1eaa-9b05-42be-9a17-b3e951a25176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:38.098759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 883/1747] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:38.106909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a909d-9797-4a63-b6c7-99e192e723dc None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.107316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a909d-9797-4a63-b6c7-99e192e723dc None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.107601 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a909d-9797-4a63-b6c7-99e192e723dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.132040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bf2a909d-9797-4a63-b6c7-99e192e723dc None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:38.133285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bf2a909d-9797-4a63-b6c7-99e192e723dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:38.147162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 865/1748] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:38.148890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af1eaa-9b05-42be-9a17-b3e951a25176 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.167814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af1eaa-9b05-42be-9a17-b3e951a25176 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.185361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af5274-ef7d-4f8d-ad06-e075d339085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.186504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af5274-ef7d-4f8d-ad06-e075d339085b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.186504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af5274-ef7d-4f8d-ad06-e075d339085b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.186876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af5274-ef7d-4f8d-ad06-e075d339085b admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.187612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af5274-ef7d-4f8d-ad06-e075d339085b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:38.187999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af5274-ef7d-4f8d-ad06-e075d339085b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.190345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af5274-ef7d-4f8d-ad06-e075d339085b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.221267 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 884/1749] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:38.224329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a909d-9797-4a63-b6c7-99e192e723dc None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.224614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af5274-ef7d-4f8d-ad06-e075d339085b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.226742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b9af5274-ef7d-4f8d-ad06-e075d339085b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:38.244228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af5274-ef7d-4f8d-ad06-e075d339085b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.244459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a909d-9797-4a63-b6c7-99e192e723dc None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.250148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.251291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.251868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.252302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] PATH_INFO: `/v3/projects/de0d1d45b8ff4c0d9b945d452c0bb319` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.254817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0d1d45b8ff4c0d9b945d452c0bb319)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.258293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c6a5d-9693-4e90-989f-d993ff455152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.259935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.260063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c6a5d-9693-4e90-989f-d993ff455152 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.260063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c6a5d-9693-4e90-989f-d993ff455152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.260063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c6a5d-9693-4e90-989f-d993ff455152 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.260063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c6a5d-9693-4e90-989f-d993ff455152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.262280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c6a5d-9693-4e90-989f-d993ff455152 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.443968 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 866/1750] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:38 2022] POST /identity/v3/projects => generated 369 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:38.447618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c6a5d-9693-4e90-989f-d993ff455152 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.475886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0d1d45b8ff4c0d9b945d452c0bb319', 'request_id': 'req-bc5a587d-0d1a-42a2-936c-09a18f754db1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:38.590514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0d1d45b8ff4c0d9b945d452c0bb319', 'request_id': 'req-bc5a587d-0d1a-42a2-936c-09a18f754db1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:38.601296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0d1d45b8ff4c0d9b945d452c0bb319', 'request_id': 'req-bc5a587d-0d1a-42a2-936c-09a18f754db1'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:38.602870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c6a5d-9693-4e90-989f-d993ff455152 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.622191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd8c4c-d40e-4938-adad-ecc3f304aab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.623640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8c4c-d40e-4938-adad-ecc3f304aab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.624189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8c4c-d40e-4938-adad-ecc3f304aab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.625695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:38.626243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8c4c-d40e-4938-adad-ecc3f304aab1 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.627190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd8c4c-d40e-4938-adad-ecc3f304aab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.630119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd8c4c-d40e-4938-adad-ecc3f304aab1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.635207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] The token cache is being invalidate because project de0d1d45b8ff4c0d9b945d452c0bb319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:38.639901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:38.639901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:38.643546 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 885/1751] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:38 2022] DELETE /identity/v3/projects/de0d1d45b8ff4c0d9b945d452c0bb319 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:38.650834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.652567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:38.851478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a587d-0d1a-42a2-936c-09a18f754db1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.871919 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ce502-5270-4646-b1d2-7db5e436f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.872612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ce502-5270-4646-b1d2-7db5e436f0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.872959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ce502-5270-4646-b1d2-7db5e436f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.873252 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ce502-5270-4646-b1d2-7db5e436f0ee admin admin] PATH_INFO: `/v3/users/91e29f5a36704f09acf623e048775f80` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.877057 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ce502-5270-4646-b1d2-7db5e436f0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e29f5a36704f09acf623e048775f80)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.885095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ce502-5270-4646-b1d2-7db5e436f0ee admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.974512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:38.999406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 867/1752] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:38 2022] POST /identity/v3/users => generated 285 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:39.007007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd8c4c-d40e-4938-adad-ecc3f304aab1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:39.021501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dbcd8c4c-d40e-4938-adad-ecc3f304aab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:39.129345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd8c4c-d40e-4938-adad-ecc3f304aab1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:39.177920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b543ea-8c41-45e0-82fd-ad382e94795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:39.181458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b543ea-8c41-45e0-82fd-ad382e94795a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.188450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b543ea-8c41-45e0-82fd-ad382e94795a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.188450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b543ea-8c41-45e0-82fd-ad382e94795a admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.188450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b543ea-8c41-45e0-82fd-ad382e94795a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:39.195590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b543ea-8c41-45e0-82fd-ad382e94795a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:39.246213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 868/1753] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:39.251179 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b543ea-8c41-45e0-82fd-ad382e94795a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:39.265396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-382ce502-5270-4646-b1d2-7db5e436f0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e29f5a36704f09acf623e048775f80'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:39.268438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-382ce502-5270-4646-b1d2-7db5e436f0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e29f5a36704f09acf623e048775f80'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:39.268966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-382ce502-5270-4646-b1d2-7db5e436f0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e29f5a36704f09acf623e048775f80'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:39.276638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b543ea-8c41-45e0-82fd-ad382e94795a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:39.284061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ab27c-6344-42ca-a8ed-819356d7e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:39.285653 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab27c-6344-42ca-a8ed-819356d7e423 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.286707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab27c-6344-42ca-a8ed-819356d7e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.287309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab27c-6344-42ca-a8ed-819356d7e423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.288824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ab27c-6344-42ca-a8ed-819356d7e423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:39.294079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ab27c-6344-42ca-a8ed-819356d7e423 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:39.325057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 869/1754] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:39.331104 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ab27c-6344-42ca-a8ed-819356d7e423 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:39.337756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-151ab27c-6344-42ca-a8ed-819356d7e423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:39.366553 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-382ce502-5270-4646-b1d2-7db5e436f0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e29f5a36704f09acf623e048775f80'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:39.382551 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ab27c-6344-42ca-a8ed-819356d7e423 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:39.390372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944c5e4-52b8-46b1-b1a2-69b030a7afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:39.390987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944c5e4-52b8-46b1-b1a2-69b030a7afd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.391171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-382ce502-5270-4646-b1d2-7db5e436f0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e29f5a36704f09acf623e048775f80'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:39.391345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944c5e4-52b8-46b1-b1a2-69b030a7afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.391643 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944c5e4-52b8-46b1-b1a2-69b030a7afd8 admin admin] PATH_INFO: `/v3/projects/e540ef4d789c4499812939e2397ab3cc/users/47ff4a814f804a688e8e3b374fac46a7/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.447469 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 886/1755] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:38 2022] DELETE /identity/v3/users/91e29f5a36704f09acf623e048775f80 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:39.453555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944c5e4-52b8-46b1-b1a2-69b030a7afd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e540ef4d789c4499812939e2397ab3cc, user_id=47ff4a814f804a688e8e3b374fac46a7, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:39.465947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944c5e4-52b8-46b1-b1a2-69b030a7afd8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:39.597755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 870/1756] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:39 2022] PUT /identity/v3/projects/e540ef4d789c4499812939e2397ab3cc/users/47ff4a814f804a688e8e3b374fac46a7/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:39.612626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89def69-ca38-4108-8917-2c7ce8fbf977 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.613155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89def69-ca38-4108-8917-2c7ce8fbf977 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.613385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89def69-ca38-4108-8917-2c7ce8fbf977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.703507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d89def69-ca38-4108-8917-2c7ce8fbf977 None None] MFA Rules not processed for user `47ff4a814f804a688e8e3b374fac46a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:39.710625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d89def69-ca38-4108-8917-2c7ce8fbf977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:39.887403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 887/1757] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:39.892215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944c5e4-52b8-46b1-b1a2-69b030a7afd8 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:40.075764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944c5e4-52b8-46b1-b1a2-69b030a7afd8 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:40.103618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92ca90-aa4b-4d90-9ffb-0040d8fd38da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:40.104446 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ca90-aa4b-4d90-9ffb-0040d8fd38da admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:40.104736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ca90-aa4b-4d90-9ffb-0040d8fd38da admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:40.105014 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ca90-aa4b-4d90-9ffb-0040d8fd38da admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:40.105687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ca90-aa4b-4d90-9ffb-0040d8fd38da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:40.107887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ca90-aa4b-4d90-9ffb-0040d8fd38da admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:40.584797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 871/1758] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:39 2022] POST /identity/v3/projects => generated 369 bytes in 693 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:40.589524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89def69-ca38-4108-8917-2c7ce8fbf977 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:40.619038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89def69-ca38-4108-8917-2c7ce8fbf977 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:40.725076 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da95932-d57a-45da-84d9-4e602e790e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:40.726126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da95932-d57a-45da-84d9-4e602e790e11 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:40.726984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da95932-d57a-45da-84d9-4e602e790e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:40.727697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da95932-d57a-45da-84d9-4e602e790e11 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:40.734065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da95932-d57a-45da-84d9-4e602e790e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:40.736459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da95932-d57a-45da-84d9-4e602e790e11 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:40.811367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256131d1-daa9-464e-b828-c36689ff5e5b None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:40.811367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256131d1-daa9-464e-b828-c36689ff5e5b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:40.811367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256131d1-daa9-464e-b828-c36689ff5e5b None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:40.815296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 872/1759] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:48:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:40.835599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1981-8bd3-410a-a53d-a8bd02d614fc None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:40.836139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1981-8bd3-410a-a53d-a8bd02d614fc None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:40.836576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1981-8bd3-410a-a53d-a8bd02d614fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:40.885954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-141f1981-8bd3-410a-a53d-a8bd02d614fc None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:40.888130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-141f1981-8bd3-410a-a53d-a8bd02d614fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:41.076040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 873/1760] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:48:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:41.203033 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f1981-8bd3-410a-a53d-a8bd02d614fc None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:41.204870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-141f1981-8bd3-410a-a53d-a8bd02d614fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:41.235323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f1981-8bd3-410a-a53d-a8bd02d614fc None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:41.282545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 888/1761] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:40 2022] POST /identity/v3/users => generated 291 bytes in 694 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:41.283790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da95932-d57a-45da-84d9-4e602e790e11 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:41.289659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2da95932-d57a-45da-84d9-4e602e790e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:41.293401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf66c03-ce9e-40b0-a9cb-2fdecf7c043c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:41.306002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf66c03-ce9e-40b0-a9cb-2fdecf7c043c service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.309531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf66c03-ce9e-40b0-a9cb-2fdecf7c043c service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.310586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf66c03-ce9e-40b0-a9cb-2fdecf7c043c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.353113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf66c03-ce9e-40b0-a9cb-2fdecf7c043c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:41.356541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da95932-d57a-45da-84d9-4e602e790e11 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:41.361605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf66c03-ce9e-40b0-a9cb-2fdecf7c043c service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:41.370184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:41.371219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.371581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.371971 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] PATH_INFO: `/v3/projects/037d28f4d2e44ab2bca41cf961d43c4a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.376738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=037d28f4d2e44ab2bca41cf961d43c4a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:41.388642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:41.396064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 874/1762] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:41.396811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf66c03-ce9e-40b0-a9cb-2fdecf7c043c service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:41.444556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf66c03-ce9e-40b0-a9cb-2fdecf7c043c service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:41.469228 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4acfc-5211-4701-be75-ccc9f5f514b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:41.469869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4acfc-5211-4701-be75-ccc9f5f514b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.470234 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4acfc-5211-4701-be75-ccc9f5f514b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.470747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4acfc-5211-4701-be75-ccc9f5f514b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.472406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4acfc-5211-4701-be75-ccc9f5f514b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:41.478990 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4acfc-5211-4701-be75-ccc9f5f514b3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:41.493603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 875/1763] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:41.494693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4acfc-5211-4701-be75-ccc9f5f514b3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:41.497173 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bdb4acfc-5211-4701-be75-ccc9f5f514b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:41.519847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4acfc-5211-4701-be75-ccc9f5f514b3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:41.519847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:41.519847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.520978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.520978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] PATH_INFO: `/v3/projects/026b1c4b1bd049a79025823821926231` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.523300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] RBAC: Authorizing `identity:delete_project(project_id=026b1c4b1bd049a79025823821926231)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:41.530272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:41.680913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037d28f4d2e44ab2bca41cf961d43c4a', 'request_id': 'req-1e89460c-887d-482e-8503-c7ce6def93d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:41.928195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026b1c4b1bd049a79025823821926231', 'request_id': 'req-3e9a8355-0604-41dd-b756-c4fd06ff201c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:41.944078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026b1c4b1bd049a79025823821926231', 'request_id': 'req-3e9a8355-0604-41dd-b756-c4fd06ff201c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:41.955798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037d28f4d2e44ab2bca41cf961d43c4a', 'request_id': 'req-1e89460c-887d-482e-8503-c7ce6def93d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:41.966663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037d28f4d2e44ab2bca41cf961d43c4a', 'request_id': 'req-1e89460c-887d-482e-8503-c7ce6def93d3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:41.994710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] The token cache is being invalidate because project 037d28f4d2e44ab2bca41cf961d43c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:41.994710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:41.996284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1e89460c-887d-482e-8503-c7ce6def93d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:42.002665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 889/1764] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:41 2022] DELETE /identity/v3/projects/037d28f4d2e44ab2bca41cf961d43c4a => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:42.004524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae2ef-17b3-4eed-8632-683580ca8d27 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:42.005063 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae2ef-17b3-4eed-8632-683580ca8d27 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:42.005523 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae2ef-17b3-4eed-8632-683580ca8d27 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:42.007132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 890/1765] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:48:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:42.008006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae2ef-17b3-4eed-8632-683580ca8d27 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:42.009823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b7bae2ef-17b3-4eed-8632-683580ca8d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:42.182152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae2ef-17b3-4eed-8632-683580ca8d27 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:42.182152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46f976-dc77-4275-9054-561b0b5090d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:42.182152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46f976-dc77-4275-9054-561b0b5090d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:42.182152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46f976-dc77-4275-9054-561b0b5090d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:42.183121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46f976-dc77-4275-9054-561b0b5090d0 admin admin] PATH_INFO: `/v3/projects/5be0c0498cfe4e4fa5c756c1eda5960a/users/b74824fd26c34d7db2c7d7fa30b9977b/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:42.183121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46f976-dc77-4275-9054-561b0b5090d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be0c0498cfe4e4fa5c756c1eda5960a, user_id=b74824fd26c34d7db2c7d7fa30b9977b, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:42.183121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46f976-dc77-4275-9054-561b0b5090d0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:42.489788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026b1c4b1bd049a79025823821926231', 'request_id': 'req-3e9a8355-0604-41dd-b756-c4fd06ff201c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:42.530215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 891/1766] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:42 2022] PUT /identity/v3/projects/5be0c0498cfe4e4fa5c756c1eda5960a/users/b74824fd26c34d7db2c7d7fa30b9977b/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:42.531712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e260-bfcb-46b6-a526-2706251d41cc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:42.531948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e260-bfcb-46b6-a526-2706251d41cc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:42.532230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499e260-bfcb-46b6-a526-2706251d41cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:42.542478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] The token cache is being invalidate because project 026b1c4b1bd049a79025823821926231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:42.542887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:42.543781 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3e9a8355-0604-41dd-b756-c4fd06ff201c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:42.551691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 876/1767] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:41 2022] DELETE /identity/v3/projects/026b1c4b1bd049a79025823821926231 => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:42.551691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75177b3-9d72-4654-a4b1-f0e2bdaf2609 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:42.551691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75177b3-9d72-4654-a4b1-f0e2bdaf2609 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:42.551691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75177b3-9d72-4654-a4b1-f0e2bdaf2609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:42.590871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b75177b3-9d72-4654-a4b1-f0e2bdaf2609 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:42.593350 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b75177b3-9d72-4654-a4b1-f0e2bdaf2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:42.599770 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1499e260-bfcb-46b6-a526-2706251d41cc None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:42.602963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1499e260-bfcb-46b6-a526-2706251d41cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:42.748680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 892/1768] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:42.750052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e260-bfcb-46b6-a526-2706251d41cc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:42.752128 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1499e260-bfcb-46b6-a526-2706251d41cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:42.777970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499e260-bfcb-46b6-a526-2706251d41cc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:42.786876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 877/1769] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:48:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:42.789843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75177b3-9d72-4654-a4b1-f0e2bdaf2609 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:42.793776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b75177b3-9d72-4654-a4b1-f0e2bdaf2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:42.799521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a6037-39f5-4610-931b-2dc6128f33f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:42.800258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a6037-39f5-4610-931b-2dc6128f33f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:42.800619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a6037-39f5-4610-931b-2dc6128f33f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:42.803169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a6037-39f5-4610-931b-2dc6128f33f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:42.810223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a6037-39f5-4610-931b-2dc6128f33f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:42.814067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a6037-39f5-4610-931b-2dc6128f33f3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:42.827351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75177b3-9d72-4654-a4b1-f0e2bdaf2609 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:42.835765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:42.837240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:42.837529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:42.837954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] PATH_INFO: `/v3/users/68005988ee314f0da69f294e7cf489a6` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:42.839621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68005988ee314f0da69f294e7cf489a6)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:42.841833 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:42.855549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 893/1770] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:42.864334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed4777-5242-4fa7-99eb-8558550987df None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:42.868588 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed4777-5242-4fa7-99eb-8558550987df None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:42.869098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed4777-5242-4fa7-99eb-8558550987df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:42.929966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-80ed4777-5242-4fa7-99eb-8558550987df None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:42.931854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-80ed4777-5242-4fa7-99eb-8558550987df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:42.947248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 894/1771] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:42.948665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed4777-5242-4fa7-99eb-8558550987df None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:42.970099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed4777-5242-4fa7-99eb-8558550987df None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:42.984099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf35ca-7c1b-4e4c-8fbf-4fd65864819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:42.984099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf35ca-7c1b-4e4c-8fbf-4fd65864819a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:42.984099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf35ca-7c1b-4e4c-8fbf-4fd65864819a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:42.984099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf35ca-7c1b-4e4c-8fbf-4fd65864819a admin admin] PATH_INFO: `/v3/projects/5be0c0498cfe4e4fa5c756c1eda5960a/users/b74824fd26c34d7db2c7d7fa30b9977b/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:42.984575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf35ca-7c1b-4e4c-8fbf-4fd65864819a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be0c0498cfe4e4fa5c756c1eda5960a, user_id=b74824fd26c34d7db2c7d7fa30b9977b, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:42.985553 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf35ca-7c1b-4e4c-8fbf-4fd65864819a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:43.012866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 895/1772] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:42 2022] PUT /identity/v3/projects/5be0c0498cfe4e4fa5c756c1eda5960a/users/b74824fd26c34d7db2c7d7fa30b9977b/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:43.015340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf35ca-7c1b-4e4c-8fbf-4fd65864819a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:43.142941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf35ca-7c1b-4e4c-8fbf-4fd65864819a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:43.148059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6f76e-01f3-4c2f-8f2d-8544c90b0b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:43.148727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f76e-01f3-4c2f-8f2d-8544c90b0b1c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:43.149007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f76e-01f3-4c2f-8f2d-8544c90b0b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:43.149275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f76e-01f3-4c2f-8f2d-8544c90b0b1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:43.150099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6f76e-01f3-4c2f-8f2d-8544c90b0b1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:43.150479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6f76e-01f3-4c2f-8f2d-8544c90b0b1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:43.152154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6f76e-01f3-4c2f-8f2d-8544c90b0b1c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:43.165821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 896/1773] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:43.166713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6f76e-01f3-4c2f-8f2d-8544c90b0b1c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:43.168649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dcc6f76e-01f3-4c2f-8f2d-8544c90b0b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:43.250527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6f76e-01f3-4c2f-8f2d-8544c90b0b1c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:43.262281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7a968-b909-4e24-adc0-3a49f97bfeba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:43.263289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7a968-b909-4e24-adc0-3a49f97bfeba service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:43.263521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7a968-b909-4e24-adc0-3a49f97bfeba service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:43.263797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7a968-b909-4e24-adc0-3a49f97bfeba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:43.284872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7a968-b909-4e24-adc0-3a49f97bfeba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:43.286838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7a968-b909-4e24-adc0-3a49f97bfeba service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:43.313182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 897/1774] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:43.315189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5caf-f5c2-4022-8444-5215a28b2b47 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:43.316192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5caf-f5c2-4022-8444-5215a28b2b47 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:43.317016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5caf-f5c2-4022-8444-5215a28b2b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:43.383078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9e7c5caf-f5c2-4022-8444-5215a28b2b47 None None] MFA Rules not processed for user `b74824fd26c34d7db2c7d7fa30b9977b`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:43.384457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9e7c5caf-f5c2-4022-8444-5215a28b2b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:43.461163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68005988ee314f0da69f294e7cf489a6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.566684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 898/1775] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:43.567827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c5caf-f5c2-4022-8444-5215a28b2b47 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:43.592132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c5caf-f5c2-4022-8444-5215a28b2b47 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:43.608067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74c513-880c-48f0-a814-e078327e58a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:43.608705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74c513-880c-48f0-a814-e078327e58a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:43.608989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74c513-880c-48f0-a814-e078327e58a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:43.609263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74c513-880c-48f0-a814-e078327e58a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:43.609910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74c513-880c-48f0-a814-e078327e58a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:43.612393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68005988ee314f0da69f294e7cf489a6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.619460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74c513-880c-48f0-a814-e078327e58a9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:43.623510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68005988ee314f0da69f294e7cf489a6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.626144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68005988ee314f0da69f294e7cf489a6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.652192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68005988ee314f0da69f294e7cf489a6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.665874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 878/1776] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:42 2022] DELETE /identity/v3/users/68005988ee314f0da69f294e7cf489a6 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:43.669416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:43.685826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:43.804552 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f4995-d080-4ab2-8387-faac32e0a985 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:43.812444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76842bf6-8504-424a-91cb-02eb1eb14305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:43.812763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 899/1777] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:43 2022] POST /identity/v3/projects => generated 367 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:43.813233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842bf6-8504-424a-91cb-02eb1eb14305 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:43.813233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842bf6-8504-424a-91cb-02eb1eb14305 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:43.813233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842bf6-8504-424a-91cb-02eb1eb14305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:43.813838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74c513-880c-48f0-a814-e078327e58a9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:43.816337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-76842bf6-8504-424a-91cb-02eb1eb14305 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:43.819889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8e74c513-880c-48f0-a814-e078327e58a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:43.972567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76842bf6-8504-424a-91cb-02eb1eb14305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:43.975712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76842bf6-8504-424a-91cb-02eb1eb14305 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:44.001030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74c513-880c-48f0-a814-e078327e58a9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:44.001373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 879/1778] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:44.008726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032905-c3d2-424f-b4f1-b27e6b197e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:44.009740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032905-c3d2-424f-b4f1-b27e6b197e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:44.010512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032905-c3d2-424f-b4f1-b27e6b197e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:44.010512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032905-c3d2-424f-b4f1-b27e6b197e86 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:44.012826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28032905-c3d2-424f-b4f1-b27e6b197e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:44.015468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28032905-c3d2-424f-b4f1-b27e6b197e86 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:44.877940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 900/1779] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:43 2022] POST /identity/v3/users => generated 284 bytes in 1065 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:44.880361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76842bf6-8504-424a-91cb-02eb1eb14305 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:45.015657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76842bf6-8504-424a-91cb-02eb1eb14305 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:45.022314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5434ba1-e757-47c9-97a4-2aaa3d1dd59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:45.023166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434ba1-e757-47c9-97a4-2aaa3d1dd59f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:45.023622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434ba1-e757-47c9-97a4-2aaa3d1dd59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:45.024057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434ba1-e757-47c9-97a4-2aaa3d1dd59f admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:45.024877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5434ba1-e757-47c9-97a4-2aaa3d1dd59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:45.038226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5434ba1-e757-47c9-97a4-2aaa3d1dd59f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:45.061421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032905-c3d2-424f-b4f1-b27e6b197e86 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:45.064667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 880/1780] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:45.080773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032905-c3d2-424f-b4f1-b27e6b197e86 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:45.109738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f1a6e-2dbb-47e0-8865-4e3d11699602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:45.110538 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f1a6e-2dbb-47e0-8865-4e3d11699602 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:45.110948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f1a6e-2dbb-47e0-8865-4e3d11699602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:45.111357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f1a6e-2dbb-47e0-8865-4e3d11699602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:45.112136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f1a6e-2dbb-47e0-8865-4e3d11699602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:45.116776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f1a6e-2dbb-47e0-8865-4e3d11699602 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:45.147816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5434ba1-e757-47c9-97a4-2aaa3d1dd59f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:45.148780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 901/1781] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:45.160899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5434ba1-e757-47c9-97a4-2aaa3d1dd59f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:45.175012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cfcad-2843-4459-8b6b-c67c36706e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:45.178021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cfcad-2843-4459-8b6b-c67c36706e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:45.178021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cfcad-2843-4459-8b6b-c67c36706e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:45.178021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cfcad-2843-4459-8b6b-c67c36706e05 admin admin] PATH_INFO: `/v3/projects/f3390caa54ef48fe9208ed6dd117f89c/users/7cedeecb6aa64cdfafca92ca9e950c58/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:45.193951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cfcad-2843-4459-8b6b-c67c36706e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3390caa54ef48fe9208ed6dd117f89c, user_id=7cedeecb6aa64cdfafca92ca9e950c58, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:45.209116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cfcad-2843-4459-8b6b-c67c36706e05 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:45.438403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:45.528376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 881/1782] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:45 2022] PUT /identity/v3/projects/f3390caa54ef48fe9208ed6dd117f89c/users/7cedeecb6aa64cdfafca92ca9e950c58/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:45.539173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce8d0-8df7-4876-b995-7c5a0c1dddca None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:45.539465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce8d0-8df7-4876-b995-7c5a0c1dddca None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:45.539740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce8d0-8df7-4876-b995-7c5a0c1dddca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:45.572832 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-303ce8d0-8df7-4876-b995-7c5a0c1dddca None None] MFA Rules not processed for user `7cedeecb6aa64cdfafca92ca9e950c58`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:45.574338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-303ce8d0-8df7-4876-b995-7c5a0c1dddca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:45.645762 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 902/1783] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:45.652380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cfcad-2843-4459-8b6b-c67c36706e05 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:45.681810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce8d0-8df7-4876-b995-7c5a0c1dddca None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:45.683327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-303ce8d0-8df7-4876-b995-7c5a0c1dddca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:45.751415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cfcad-2843-4459-8b6b-c67c36706e05 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:45.769474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669035e0-78c3-4d21-9566-cf7cda0e6707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:45.770223 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669035e0-78c3-4d21-9566-cf7cda0e6707 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:45.770505 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669035e0-78c3-4d21-9566-cf7cda0e6707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:45.770780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669035e0-78c3-4d21-9566-cf7cda0e6707 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:45.772098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669035e0-78c3-4d21-9566-cf7cda0e6707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:45.773556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669035e0-78c3-4d21-9566-cf7cda0e6707 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:45.776532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce8d0-8df7-4876-b995-7c5a0c1dddca None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:45.782827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:45.783899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:45.784392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:45.784746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] PATH_INFO: `/v3/projects/c750078824734acbaa8153bf075ca5ae` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:45.786813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c750078824734acbaa8153bf075ca5ae)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:45.788922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.035116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 882/1784] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:45 2022] POST /identity/v3/projects => generated 369 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:46.036940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669035e0-78c3-4d21-9566-cf7cda0e6707 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.044911 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c750078824734acbaa8153bf075ca5ae', 'request_id': 'req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:46.114683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669035e0-78c3-4d21-9566-cf7cda0e6707 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.120110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5717c7b-fc2d-4e0e-892c-b278b824f88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.125389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5717c7b-fc2d-4e0e-892c-b278b824f88a admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.125389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5717c7b-fc2d-4e0e-892c-b278b824f88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.125389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5717c7b-fc2d-4e0e-892c-b278b824f88a admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.125389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5717c7b-fc2d-4e0e-892c-b278b824f88a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.125389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5717c7b-fc2d-4e0e-892c-b278b824f88a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.161082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c750078824734acbaa8153bf075ca5ae', 'request_id': 'req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:46.171239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c750078824734acbaa8153bf075ca5ae', 'request_id': 'req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:46.180613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] The token cache is being invalidate because project c750078824734acbaa8153bf075ca5ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:46.180913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:46.181576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c5b3e90-2e4e-4d9e-a9da-0e88609a7640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:46.183166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 903/1785] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:45 2022] DELETE /identity/v3/projects/c750078824734acbaa8153bf075ca5ae => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:46.189074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad009f-439c-4abd-989b-93066d93ead9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.189428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad009f-439c-4abd-989b-93066d93ead9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.189712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad009f-439c-4abd-989b-93066d93ead9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.219385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e6ad009f-439c-4abd-989b-93066d93ead9 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:46.220698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e6ad009f-439c-4abd-989b-93066d93ead9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:46.231248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 904/1786] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:46.238239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c109b-75e3-4764-a87e-af4c44eac65a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.240201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c109b-75e3-4764-a87e-af4c44eac65a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.240201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c109b-75e3-4764-a87e-af4c44eac65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.240403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 883/1787] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:46 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:46.244579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5717c7b-fc2d-4e0e-892c-b278b824f88a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.248053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c5717c7b-fc2d-4e0e-892c-b278b824f88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:46.261790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5717c7b-fc2d-4e0e-892c-b278b824f88a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.266395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-643c109b-75e3-4764-a87e-af4c44eac65a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:46.266395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-643c109b-75e3-4764-a87e-af4c44eac65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:46.266773 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdc608-5a34-4a22-83c7-d927d599450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.267548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdc608-5a34-4a22-83c7-d927d599450c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.267835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdc608-5a34-4a22-83c7-d927d599450c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.268132 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdc608-5a34-4a22-83c7-d927d599450c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.268782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdc608-5a34-4a22-83c7-d927d599450c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.271026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdc608-5a34-4a22-83c7-d927d599450c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.276906 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 905/1788] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:46.282014 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c109b-75e3-4764-a87e-af4c44eac65a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.292947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 884/1789] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:46.294224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdc608-5a34-4a22-83c7-d927d599450c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.294361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c109b-75e3-4764-a87e-af4c44eac65a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.300065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4efdf-587a-4763-9da3-736f9989f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.303201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4efdf-587a-4763-9da3-736f9989f9eb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.306634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4efdf-587a-4763-9da3-736f9989f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.306634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4efdf-587a-4763-9da3-736f9989f9eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.306634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4efdf-587a-4763-9da3-736f9989f9eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:46.306634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4efdf-587a-4763-9da3-736f9989f9eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.308092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4efdf-587a-4763-9da3-736f9989f9eb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.312990 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdc608-5a34-4a22-83c7-d927d599450c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.325301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 906/1790] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:46.326606 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4efdf-587a-4763-9da3-736f9989f9eb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.334107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f385ee-aa87-4afb-9158-7e40f53f2314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.344429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f385ee-aa87-4afb-9158-7e40f53f2314 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.344429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f385ee-aa87-4afb-9158-7e40f53f2314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.344429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f385ee-aa87-4afb-9158-7e40f53f2314 admin admin] PATH_INFO: `/v3/projects/3dc8863f3e934301b5f44ac873d06e25/users/5ee2514924f944808a21134a2196880b/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.345602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4efdf-587a-4763-9da3-736f9989f9eb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.358109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e858a-037d-4c53-868d-b50d0e5d5c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.358769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e858a-037d-4c53-868d-b50d0e5d5c4a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.359329 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e858a-037d-4c53-868d-b50d0e5d5c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.359726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e858a-037d-4c53-868d-b50d0e5d5c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.360388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e858a-037d-4c53-868d-b50d0e5d5c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.362453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e858a-037d-4c53-868d-b50d0e5d5c4a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.386132 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f385ee-aa87-4afb-9158-7e40f53f2314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc8863f3e934301b5f44ac873d06e25, user_id=5ee2514924f944808a21134a2196880b, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.389385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f385ee-aa87-4afb-9158-7e40f53f2314 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.395786 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:46.529265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 885/1791] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:46 2022] PUT /identity/v3/projects/3dc8863f3e934301b5f44ac873d06e25/users/5ee2514924f944808a21134a2196880b/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:46.536062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f385ee-aa87-4afb-9158-7e40f53f2314 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.549492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 907/1792] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:46 2022] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:46.556591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e858a-037d-4c53-868d-b50d0e5d5c4a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.650552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e858a-037d-4c53-868d-b50d0e5d5c4a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.657364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42456a51-6e32-4389-b61c-b71a36611425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.658095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42456a51-6e32-4389-b61c-b71a36611425 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.658448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42456a51-6e32-4389-b61c-b71a36611425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.658790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42456a51-6e32-4389-b61c-b71a36611425 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.659564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42456a51-6e32-4389-b61c-b71a36611425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.661684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42456a51-6e32-4389-b61c-b71a36611425 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.668328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f385ee-aa87-4afb-9158-7e40f53f2314 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.676784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa1848-37da-414b-8745-2c74620357e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.677632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa1848-37da-414b-8745-2c74620357e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.677971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa1848-37da-414b-8745-2c74620357e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.678254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa1848-37da-414b-8745-2c74620357e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.678998 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa1848-37da-414b-8745-2c74620357e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.681357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa1848-37da-414b-8745-2c74620357e6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.698232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 886/1793] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:46.703012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa1848-37da-414b-8745-2c74620357e6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.718201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa1848-37da-414b-8745-2c74620357e6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.739958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01b39d-9226-4400-9c35-5cf8c1689072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.739958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01b39d-9226-4400-9c35-5cf8c1689072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.739958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01b39d-9226-4400-9c35-5cf8c1689072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.739958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01b39d-9226-4400-9c35-5cf8c1689072 admin admin] PATH_INFO: `/v3/projects/3dc8863f3e934301b5f44ac873d06e25/users/5ee2514924f944808a21134a2196880b/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.743693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01b39d-9226-4400-9c35-5cf8c1689072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc8863f3e934301b5f44ac873d06e25, user_id=5ee2514924f944808a21134a2196880b, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.758064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01b39d-9226-4400-9c35-5cf8c1689072 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.784496 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 887/1794] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:46 2022] PUT /identity/v3/projects/3dc8863f3e934301b5f44ac873d06e25/users/5ee2514924f944808a21134a2196880b/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:46.792097 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129a6f-75ae-46db-a6e7-d7512985f842 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.792435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129a6f-75ae-46db-a6e7-d7512985f842 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.792689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129a6f-75ae-46db-a6e7-d7512985f842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.827759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f5129a6f-75ae-46db-a6e7-d7512985f842 None None] MFA Rules not processed for user `5ee2514924f944808a21134a2196880b`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:46.829022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f5129a6f-75ae-46db-a6e7-d7512985f842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:46.852918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 908/1795] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:46 2022] POST /identity/v3/users => generated 290 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:46.857317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42456a51-6e32-4389-b61c-b71a36611425 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.868004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42456a51-6e32-4389-b61c-b71a36611425 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.933198 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda580b-9d60-4c15-829c-bd792dd7c185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.933828 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda580b-9d60-4c15-829c-bd792dd7c185 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.935519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda580b-9d60-4c15-829c-bd792dd7c185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.935519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda580b-9d60-4c15-829c-bd792dd7c185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.935519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda580b-9d60-4c15-829c-bd792dd7c185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.936869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda580b-9d60-4c15-829c-bd792dd7c185 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.938894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 888/1796] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:46.946714 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5129a6f-75ae-46db-a6e7-d7512985f842 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.949840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 909/1797] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:46.950596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f5129a6f-75ae-46db-a6e7-d7512985f842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:46.963960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda580b-9d60-4c15-829c-bd792dd7c185 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.980613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda580b-9d60-4c15-829c-bd792dd7c185 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.987213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e4f8-d4f1-4793-aed2-45ac242fca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.987842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e4f8-d4f1-4793-aed2-45ac242fca3f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.988295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e4f8-d4f1-4793-aed2-45ac242fca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.988632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e4f8-d4f1-4793-aed2-45ac242fca3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.990321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762e4f8-d4f1-4793-aed2-45ac242fca3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.992353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762e4f8-d4f1-4793-aed2-45ac242fca3f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.006442 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 910/1798] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:47.010764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e4f8-d4f1-4793-aed2-45ac242fca3f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.017384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5129a6f-75ae-46db-a6e7-d7512985f842 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.022448 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893e3a1-233e-4ca1-8fde-b688f352c413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.023121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893e3a1-233e-4ca1-8fde-b688f352c413 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.023593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893e3a1-233e-4ca1-8fde-b688f352c413 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.023813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893e3a1-233e-4ca1-8fde-b688f352c413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.027276 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e4f8-d4f1-4793-aed2-45ac242fca3f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.034317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481d451-3e65-40c6-a15f-d2eb40adc449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.034465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893e3a1-233e-4ca1-8fde-b688f352c413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.036428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893e3a1-233e-4ca1-8fde-b688f352c413 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.037177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d451-3e65-40c6-a15f-d2eb40adc449 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.037649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d451-3e65-40c6-a15f-d2eb40adc449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.038113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d451-3e65-40c6-a15f-d2eb40adc449 admin admin] PATH_INFO: `/v3/projects/58cc435a96444b9a92d6dcbb3b35f3a6/users/29000808c6b2416f9eea85ec838d61b7/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.057561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 889/1799] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:47.058983 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481d451-3e65-40c6-a15f-d2eb40adc449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cc435a96444b9a92d6dcbb3b35f3a6, user_id=29000808c6b2416f9eea85ec838d61b7, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.061970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481d451-3e65-40c6-a15f-d2eb40adc449 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.207184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 911/1800] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:47 2022] PUT /identity/v3/projects/58cc435a96444b9a92d6dcbb3b35f3a6/users/29000808c6b2416f9eea85ec838d61b7/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:47.214297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049af146-0411-49a6-ad00-937d6bf4af3e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.214590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049af146-0411-49a6-ad00-937d6bf4af3e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.214873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049af146-0411-49a6-ad00-937d6bf4af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.252348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481d451-3e65-40c6-a15f-d2eb40adc449 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.252556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-049af146-0411-49a6-ad00-937d6bf4af3e None None] MFA Rules not processed for user `29000808c6b2416f9eea85ec838d61b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:47.255001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-049af146-0411-49a6-ad00-937d6bf4af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:47.311372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481d451-3e65-40c6-a15f-d2eb40adc449 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.314876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c8477-ceda-4db6-8ebe-9db90b18e986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.315546 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8477-ceda-4db6-8ebe-9db90b18e986 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.315830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8477-ceda-4db6-8ebe-9db90b18e986 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.316111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8477-ceda-4db6-8ebe-9db90b18e986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.317871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-857c8477-ceda-4db6-8ebe-9db90b18e986 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:47.327198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 890/1801] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:47.329375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049af146-0411-49a6-ad00-937d6bf4af3e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.388643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c8477-ceda-4db6-8ebe-9db90b18e986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.388820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c8477-ceda-4db6-8ebe-9db90b18e986 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.397461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049af146-0411-49a6-ad00-937d6bf4af3e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.403195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5359aa9-9627-4292-99ca-60cce25583b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.403849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5359aa9-9627-4292-99ca-60cce25583b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.404128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5359aa9-9627-4292-99ca-60cce25583b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.404405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5359aa9-9627-4292-99ca-60cce25583b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.405049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5359aa9-9627-4292-99ca-60cce25583b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.406979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5359aa9-9627-4292-99ca-60cce25583b6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.425759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 912/1802] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:47.535016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 891/1803] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:47 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:47.539797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c8477-ceda-4db6-8ebe-9db90b18e986 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.551556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c8477-ceda-4db6-8ebe-9db90b18e986 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.614171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868eaa7-5b02-4db2-a400-3aa720c81098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.614882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868eaa7-5b02-4db2-a400-3aa720c81098 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.615269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868eaa7-5b02-4db2-a400-3aa720c81098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.615552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868eaa7-5b02-4db2-a400-3aa720c81098 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.616196 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868eaa7-5b02-4db2-a400-3aa720c81098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.618129 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868eaa7-5b02-4db2-a400-3aa720c81098 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.809420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 913/1804] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:47 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:47.813149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5359aa9-9627-4292-99ca-60cce25583b6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.832763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5359aa9-9627-4292-99ca-60cce25583b6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.838017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa03d7c-7bd9-481d-8dd2-7dc71dd93003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.838635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03d7c-7bd9-481d-8dd2-7dc71dd93003 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.838920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03d7c-7bd9-481d-8dd2-7dc71dd93003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.839253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03d7c-7bd9-481d-8dd2-7dc71dd93003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.839882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa03d7c-7bd9-481d-8dd2-7dc71dd93003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.841599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa03d7c-7bd9-481d-8dd2-7dc71dd93003 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.852810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 892/1805] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:47.857127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868eaa7-5b02-4db2-a400-3aa720c81098 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.868340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868eaa7-5b02-4db2-a400-3aa720c81098 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.873230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5285e03-a79a-4cb9-afa7-7172ef778024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.873833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5285e03-a79a-4cb9-afa7-7172ef778024 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.874116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5285e03-a79a-4cb9-afa7-7172ef778024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.874385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5285e03-a79a-4cb9-afa7-7172ef778024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.875030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5285e03-a79a-4cb9-afa7-7172ef778024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.876669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5285e03-a79a-4cb9-afa7-7172ef778024 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.887362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 914/1806] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:47.892207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa03d7c-7bd9-481d-8dd2-7dc71dd93003 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.903107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa03d7c-7bd9-481d-8dd2-7dc71dd93003 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.907648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383baa96-abb0-47a9-be18-0c6035225146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.908294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383baa96-abb0-47a9-be18-0c6035225146 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.908576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383baa96-abb0-47a9-be18-0c6035225146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.908850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383baa96-abb0-47a9-be18-0c6035225146 admin admin] PATH_INFO: `/v3/projects/5df2e9283577496cb0f44a485a8f0d41/users/6e4b11d62c0a4965b9d8e225c5838835/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.926972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383baa96-abb0-47a9-be18-0c6035225146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df2e9283577496cb0f44a485a8f0d41, user_id=6e4b11d62c0a4965b9d8e225c5838835, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.929804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383baa96-abb0-47a9-be18-0c6035225146 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.013309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 893/1807] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:47 2022] PUT /identity/v3/projects/5df2e9283577496cb0f44a485a8f0d41/users/6e4b11d62c0a4965b9d8e225c5838835/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:48.024300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfc59e-9ca7-4132-a9a7-09da4b9f88ea None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.024592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfc59e-9ca7-4132-a9a7-09da4b9f88ea None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.024876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfc59e-9ca7-4132-a9a7-09da4b9f88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.056214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-29dfc59e-9ca7-4132-a9a7-09da4b9f88ea None None] MFA Rules not processed for user `6e4b11d62c0a4965b9d8e225c5838835`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:48.057455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-29dfc59e-9ca7-4132-a9a7-09da4b9f88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:48.137039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 915/1808] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:48.141427 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383baa96-abb0-47a9-be18-0c6035225146 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.233978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383baa96-abb0-47a9-be18-0c6035225146 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.240668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90ce1-4acb-4908-a3f3-fb52078cdd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.241436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90ce1-4acb-4908-a3f3-fb52078cdd31 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.241857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90ce1-4acb-4908-a3f3-fb52078cdd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.242239 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb90ce1-4acb-4908-a3f3-fb52078cdd31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.243023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb90ce1-4acb-4908-a3f3-fb52078cdd31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.245224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb90ce1-4acb-4908-a3f3-fb52078cdd31 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.381100 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 894/1809] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:48 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:48.386328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfc59e-9ca7-4132-a9a7-09da4b9f88ea None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.398305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfc59e-9ca7-4132-a9a7-09da4b9f88ea None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.528396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7189a-cdf7-46b8-b2c4-76283eaad338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.529002 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7189a-cdf7-46b8-b2c4-76283eaad338 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.529284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7189a-cdf7-46b8-b2c4-76283eaad338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.529570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7189a-cdf7-46b8-b2c4-76283eaad338 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.530437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7189a-cdf7-46b8-b2c4-76283eaad338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.532445 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7189a-cdf7-46b8-b2c4-76283eaad338 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.663020 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 916/1810] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:48 2022] POST /identity/v3/users => generated 295 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:48.663603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90ce1-4acb-4908-a3f3-fb52078cdd31 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.681429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb90ce1-4acb-4908-a3f3-fb52078cdd31 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.698149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56542ad-b46d-4941-991b-bd84b9328f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.698918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56542ad-b46d-4941-991b-bd84b9328f3e admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.699297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56542ad-b46d-4941-991b-bd84b9328f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.699774 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56542ad-b46d-4941-991b-bd84b9328f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.702517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56542ad-b46d-4941-991b-bd84b9328f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.707812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56542ad-b46d-4941-991b-bd84b9328f3e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.721876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 895/1811] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:48.728043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7189a-cdf7-46b8-b2c4-76283eaad338 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.746694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7189a-cdf7-46b8-b2c4-76283eaad338 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.758131 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075a101-a724-4f14-954f-1e5d1e922e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.760187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075a101-a724-4f14-954f-1e5d1e922e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.760743 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075a101-a724-4f14-954f-1e5d1e922e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.761271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075a101-a724-4f14-954f-1e5d1e922e3f admin admin] PATH_INFO: `/v3/projects/ac748079367848858df8e14ef0aae7cd/users/e3ad1c7b01a74911b27ea5c1c54f2cdc/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.789760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075a101-a724-4f14-954f-1e5d1e922e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac748079367848858df8e14ef0aae7cd, user_id=e3ad1c7b01a74911b27ea5c1c54f2cdc, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.792702 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075a101-a724-4f14-954f-1e5d1e922e3f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.950130 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 917/1812] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:48 2022] PUT /identity/v3/projects/ac748079367848858df8e14ef0aae7cd/users/e3ad1c7b01a74911b27ea5c1c54f2cdc/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:48.954791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56542ad-b46d-4941-991b-bd84b9328f3e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.968972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56542ad-b46d-4941-991b-bd84b9328f3e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.044047 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e65c41-858c-48fd-ba72-ffffd08df68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.044819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65c41-858c-48fd-ba72-ffffd08df68b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.044991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65c41-858c-48fd-ba72-ffffd08df68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.045344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e65c41-858c-48fd-ba72-ffffd08df68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.046199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e65c41-858c-48fd-ba72-ffffd08df68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.048022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e65c41-858c-48fd-ba72-ffffd08df68b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.074304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 896/1813] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:49.078106 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075a101-a724-4f14-954f-1e5d1e922e3f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.093566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075a101-a724-4f14-954f-1e5d1e922e3f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.102470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d1ea0-fc11-4eaf-b9d9-eb5d557f04b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.111975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d1ea0-fc11-4eaf-b9d9-eb5d557f04b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.111975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d1ea0-fc11-4eaf-b9d9-eb5d557f04b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.111975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d1ea0-fc11-4eaf-b9d9-eb5d557f04b0 admin admin] PATH_INFO: `/v3/projects/ac748079367848858df8e14ef0aae7cd/users/e3ad1c7b01a74911b27ea5c1c54f2cdc/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.111975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d1ea0-fc11-4eaf-b9d9-eb5d557f04b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac748079367848858df8e14ef0aae7cd, user_id=e3ad1c7b01a74911b27ea5c1c54f2cdc, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.113844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d1ea0-fc11-4eaf-b9d9-eb5d557f04b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.133232 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 918/1814] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:49 2022] PUT /identity/v3/projects/ac748079367848858df8e14ef0aae7cd/users/e3ad1c7b01a74911b27ea5c1c54f2cdc/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:49.144075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cece1fb-3ec4-4b6a-a7a6-18111efd9784 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.144075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cece1fb-3ec4-4b6a-a7a6-18111efd9784 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.144703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cece1fb-3ec4-4b6a-a7a6-18111efd9784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.174948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4cece1fb-3ec4-4b6a-a7a6-18111efd9784 None None] MFA Rules not processed for user `e3ad1c7b01a74911b27ea5c1c54f2cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:49.177038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4cece1fb-3ec4-4b6a-a7a6-18111efd9784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:49.252684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d1ea0-fc11-4eaf-b9d9-eb5d557f04b0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.254423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-576d1ea0-fc11-4eaf-b9d9-eb5d557f04b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:49.274611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 897/1815] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:49.282800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cece1fb-3ec4-4b6a-a7a6-18111efd9784 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.380789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cece1fb-3ec4-4b6a-a7a6-18111efd9784 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.393451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3ae6a-62c7-4fca-847b-c68003d3e005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.393451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3ae6a-62c7-4fca-847b-c68003d3e005 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.398089 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3ae6a-62c7-4fca-847b-c68003d3e005 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.398089 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3ae6a-62c7-4fca-847b-c68003d3e005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.400888 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d1ea0-fc11-4eaf-b9d9-eb5d557f04b0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.412117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.413752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.414205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.414872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] PATH_INFO: `/v3/users/47ff4a814f804a688e8e3b374fac46a7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.416812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ff4a814f804a688e8e3b374fac46a7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.420844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3ae6a-62c7-4fca-847b-c68003d3e005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.423190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.433888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3ae6a-62c7-4fca-847b-c68003d3e005 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.471281 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 898/1816] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:49.742849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3ae6a-62c7-4fca-847b-c68003d3e005 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.755885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3ae6a-62c7-4fca-847b-c68003d3e005 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.763983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c08e47-394f-49ea-8494-ff1d9e64964a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.764992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c08e47-394f-49ea-8494-ff1d9e64964a service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.765375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c08e47-394f-49ea-8494-ff1d9e64964a service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.765737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c08e47-394f-49ea-8494-ff1d9e64964a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.874620 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c08e47-394f-49ea-8494-ff1d9e64964a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.876506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c08e47-394f-49ea-8494-ff1d9e64964a service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.891789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 899/1817] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:49.939658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ff4a814f804a688e8e3b374fac46a7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:49.941332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ff4a814f804a688e8e3b374fac46a7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:49.949221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ff4a814f804a688e8e3b374fac46a7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:50.082417 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ff4a814f804a688e8e3b374fac46a7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:50.100657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ff4a814f804a688e8e3b374fac46a7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:50.121658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 919/1818] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:49 2022] DELETE /identity/v3/users/47ff4a814f804a688e8e3b374fac46a7 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:50.123442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a02e1e-a846-489a-aefd-11e07329fbd8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:50.123737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a02e1e-a846-489a-aefd-11e07329fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:50.124048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a02e1e-a846-489a-aefd-11e07329fbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:50.153644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a5a02e1e-a846-489a-aefd-11e07329fbd8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:50.154966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a5a02e1e-a846-489a-aefd-11e07329fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:50.216636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 900/1819] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:50.231016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:50.231016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:50.290868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13407426-d474-4509-ad97-142d8ea3f661 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:50.295686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb18c0-7a40-4f04-8fc2-4c835d0705be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:50.296334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb18c0-7a40-4f04-8fc2-4c835d0705be service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:50.297330 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb18c0-7a40-4f04-8fc2-4c835d0705be service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:50.297616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb18c0-7a40-4f04-8fc2-4c835d0705be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:50.307974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb18c0-7a40-4f04-8fc2-4c835d0705be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:50.309491 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb18c0-7a40-4f04-8fc2-4c835d0705be service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:50.321175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 920/1820] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:50.680183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:51.493147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a02e1e-a846-489a-aefd-11e07329fbd8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:51.495912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a5a02e1e-a846-489a-aefd-11e07329fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:51.526915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a02e1e-a846-489a-aefd-11e07329fbd8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:51.533506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:51.537285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:51.538116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:51.538574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] PATH_INFO: `/v3/projects/e540ef4d789c4499812939e2397ab3cc` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:51.542849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e540ef4d789c4499812939e2397ab3cc)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:51.544775 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:51.749027 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e540ef4d789c4499812939e2397ab3cc', 'request_id': 'req-cf9fd86f-b964-4edf-b396-3f231f45cd92'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.750542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:51.781613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e540ef4d789c4499812939e2397ab3cc', 'request_id': 'req-cf9fd86f-b964-4edf-b396-3f231f45cd92'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.886095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e540ef4d789c4499812939e2397ab3cc', 'request_id': 'req-cf9fd86f-b964-4edf-b396-3f231f45cd92'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.906589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] The token cache is being invalidate because project e540ef4d789c4499812939e2397ab3cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:51.906900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.907834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.909968 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 901/1821] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:51 2022] DELETE /identity/v3/projects/e540ef4d789c4499812939e2397ab3cc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:51.913946 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb18c0-7a40-4f04-8fc2-4c835d0705be service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:51.924823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb18c0-7a40-4f04-8fc2-4c835d0705be service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:52.025341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea98136-c577-4f49-a422-d74e733cbe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:52.026698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea98136-c577-4f49-a422-d74e733cbe4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:52.027208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea98136-c577-4f49-a422-d74e733cbe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:52.028189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea98136-c577-4f49-a422-d74e733cbe4c admin admin] PATH_INFO: `/v3/users/b74824fd26c34d7db2c7d7fa30b9977b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:52.030115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea98136-c577-4f49-a422-d74e733cbe4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74824fd26c34d7db2c7d7fa30b9977b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:52.033123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea98136-c577-4f49-a422-d74e733cbe4c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:52.290816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ea98136-c577-4f49-a422-d74e733cbe4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74824fd26c34d7db2c7d7fa30b9977b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.291769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ea98136-c577-4f49-a422-d74e733cbe4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74824fd26c34d7db2c7d7fa30b9977b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.292385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ea98136-c577-4f49-a422-d74e733cbe4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74824fd26c34d7db2c7d7fa30b9977b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.383899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ea98136-c577-4f49-a422-d74e733cbe4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74824fd26c34d7db2c7d7fa30b9977b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.397652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1ea98136-c577-4f49-a422-d74e733cbe4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74824fd26c34d7db2c7d7fa30b9977b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.415384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 921/1822] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:51 2022] DELETE /identity/v3/users/b74824fd26c34d7db2c7d7fa30b9977b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:53.700271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:53.703332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:53.743691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fd86f-b964-4edf-b396-3f231f45cd92 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:53.843621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:53.843621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:53.843621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:53.843621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] PATH_INFO: `/v3/projects/5be0c0498cfe4e4fa5c756c1eda5960a` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:53.844141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be0c0498cfe4e4fa5c756c1eda5960a)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:53.845680 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:54.026087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be0c0498cfe4e4fa5c756c1eda5960a', 'request_id': 'req-e1537cbd-5286-46e9-999d-2d49e0610e45'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.043463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be0c0498cfe4e4fa5c756c1eda5960a', 'request_id': 'req-e1537cbd-5286-46e9-999d-2d49e0610e45'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.137952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be0c0498cfe4e4fa5c756c1eda5960a', 'request_id': 'req-e1537cbd-5286-46e9-999d-2d49e0610e45'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.153633 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] The token cache is being invalidate because project 5be0c0498cfe4e4fa5c756c1eda5960a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:54.154106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.154909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e1537cbd-5286-46e9-999d-2d49e0610e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.157140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 902/1823] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:53 2022] DELETE /identity/v3/projects/5be0c0498cfe4e4fa5c756c1eda5960a => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:54.164085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea2e10-048e-4616-9523-93d40e74f954 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:54.164609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea2e10-048e-4616-9523-93d40e74f954 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:54.164609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea2e10-048e-4616-9523-93d40e74f954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:54.205407 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5aea2e10-048e-4616-9523-93d40e74f954 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:54.206928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5aea2e10-048e-4616-9523-93d40e74f954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:54.323026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 922/1824] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:54.324728 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbb3d-4345-46d1-aa19-b8449ec8f8f1 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:54.325149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbb3d-4345-46d1-aa19-b8449ec8f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:54.325301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbb3d-4345-46d1-aa19-b8449ec8f8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:54.366108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-912fbb3d-4345-46d1-aa19-b8449ec8f8f1 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:54.370868 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-912fbb3d-4345-46d1-aa19-b8449ec8f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:54.377314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 903/1825] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:54.384287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea2e10-048e-4616-9523-93d40e74f954 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:54.396271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea2e10-048e-4616-9523-93d40e74f954 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:54.401422 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb2430-a002-4b4a-8a92-5b4d8a85a111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:54.402156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2430-a002-4b4a-8a92-5b4d8a85a111 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:54.402617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2430-a002-4b4a-8a92-5b4d8a85a111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:54.403078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb2430-a002-4b4a-8a92-5b4d8a85a111 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:54.403889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb2430-a002-4b4a-8a92-5b4d8a85a111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:54.404376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb2430-a002-4b4a-8a92-5b4d8a85a111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:54.406057 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb2430-a002-4b4a-8a92-5b4d8a85a111 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:54.418374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 923/1826] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:54.422896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fbb3d-4345-46d1-aa19-b8449ec8f8f1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:54.438468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fbb3d-4345-46d1-aa19-b8449ec8f8f1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:54.443984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a38d59-cf00-43de-ba00-930d8c72c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:54.444682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a38d59-cf00-43de-ba00-930d8c72c0bd admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:54.444961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a38d59-cf00-43de-ba00-930d8c72c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:54.445241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a38d59-cf00-43de-ba00-930d8c72c0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:54.445924 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a38d59-cf00-43de-ba00-930d8c72c0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:54.447932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a38d59-cf00-43de-ba00-930d8c72c0bd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:54.570752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 904/1827] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:54 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:54.573468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb2430-a002-4b4a-8a92-5b4d8a85a111 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:54.584315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb2430-a002-4b4a-8a92-5b4d8a85a111 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:54.686383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d498c09-e454-48f4-95c7-fb403d2070b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:54.687639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498c09-e454-48f4-95c7-fb403d2070b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:54.688089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498c09-e454-48f4-95c7-fb403d2070b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:54.688530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498c09-e454-48f4-95c7-fb403d2070b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:54.689429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d498c09-e454-48f4-95c7-fb403d2070b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:54.693049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d498c09-e454-48f4-95c7-fb403d2070b8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:54.849218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 924/1828] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:54 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:54.854380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a38d59-cf00-43de-ba00-930d8c72c0bd admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:54.893703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a38d59-cf00-43de-ba00-930d8c72c0bd admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:54.909986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d498c09-e454-48f4-95c7-fb403d2070b8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:54.912819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc36ef-3b44-43db-b491-28fb4ac8a412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:54.913357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d498c09-e454-48f4-95c7-fb403d2070b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:54.913500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc36ef-3b44-43db-b491-28fb4ac8a412 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:54.916386 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc36ef-3b44-43db-b491-28fb4ac8a412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:54.916690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc36ef-3b44-43db-b491-28fb4ac8a412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:54.918405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc36ef-3b44-43db-b491-28fb4ac8a412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:54.921352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc36ef-3b44-43db-b491-28fb4ac8a412 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:54.937046 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d498c09-e454-48f4-95c7-fb403d2070b8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:54.949925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 905/1829] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:54.954949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc36ef-3b44-43db-b491-28fb4ac8a412 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:54.956247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500a1c3-9a01-4ff6-b203-1a320e83cbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:54.956914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500a1c3-9a01-4ff6-b203-1a320e83cbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:54.957228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500a1c3-9a01-4ff6-b203-1a320e83cbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:54.957511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500a1c3-9a01-4ff6-b203-1a320e83cbbf admin admin] PATH_INFO: `/v3/users/7cedeecb6aa64cdfafca92ca9e950c58` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:54.959113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500a1c3-9a01-4ff6-b203-1a320e83cbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cedeecb6aa64cdfafca92ca9e950c58)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:54.961147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500a1c3-9a01-4ff6-b203-1a320e83cbbf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:54.967540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc36ef-3b44-43db-b491-28fb4ac8a412 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:54.976345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c66c9-4e73-495c-979c-f025d05ab05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:54.977326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c66c9-4e73-495c-979c-f025d05ab05c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:54.977887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c66c9-4e73-495c-979c-f025d05ab05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:54.978313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c66c9-4e73-495c-979c-f025d05ab05c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:54.979201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c66c9-4e73-495c-979c-f025d05ab05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:54.982032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c66c9-4e73-495c-979c-f025d05ab05c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:54.994931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 906/1830] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:55.000156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c66c9-4e73-495c-979c-f025d05ab05c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:55.010690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c66c9-4e73-495c-979c-f025d05ab05c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:55.017672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56296ac-5e38-4828-bbd9-3353bc411329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:55.018375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56296ac-5e38-4828-bbd9-3353bc411329 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.018666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56296ac-5e38-4828-bbd9-3353bc411329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.018949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56296ac-5e38-4828-bbd9-3353bc411329 admin admin] PATH_INFO: `/v3/projects/f263e537075b47cc88eafe89fcdf58cf/users/44c3c73cb34949a79c2d828c2815abcc/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.052857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56296ac-5e38-4828-bbd9-3353bc411329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f263e537075b47cc88eafe89fcdf58cf, user_id=44c3c73cb34949a79c2d828c2815abcc, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:55.055597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56296ac-5e38-4828-bbd9-3353bc411329 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:55.188520 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 907/1831] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:54 2022] PUT /identity/v3/projects/f263e537075b47cc88eafe89fcdf58cf/users/44c3c73cb34949a79c2d828c2815abcc/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:55.200008 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5c02-f04c-4b74-9f69-e0142d9ba1ab None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.200315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5c02-f04c-4b74-9f69-e0142d9ba1ab None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.200788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f5c02-f04c-4b74-9f69-e0142d9ba1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.230243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8c8f5c02-f04c-4b74-9f69-e0142d9ba1ab None None] MFA Rules not processed for user `44c3c73cb34949a79c2d828c2815abcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:55.231627 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8c8f5c02-f04c-4b74-9f69-e0142d9ba1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.255353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a500a1c3-9a01-4ff6-b203-1a320e83cbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cedeecb6aa64cdfafca92ca9e950c58'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.256094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a500a1c3-9a01-4ff6-b203-1a320e83cbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cedeecb6aa64cdfafca92ca9e950c58'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.256639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a500a1c3-9a01-4ff6-b203-1a320e83cbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cedeecb6aa64cdfafca92ca9e950c58'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.296824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 908/1832] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:55.302081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f5c02-f04c-4b74-9f69-e0142d9ba1ab None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:55.303578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8c8f5c02-f04c-4b74-9f69-e0142d9ba1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.343712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a500a1c3-9a01-4ff6-b203-1a320e83cbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cedeecb6aa64cdfafca92ca9e950c58'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.357726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a500a1c3-9a01-4ff6-b203-1a320e83cbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cedeecb6aa64cdfafca92ca9e950c58'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.372149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 925/1833] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:54 2022] DELETE /identity/v3/users/7cedeecb6aa64cdfafca92ca9e950c58 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:55.376845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fb0d4-d94d-4152-b665-28a66ada2181 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.377410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fb0d4-d94d-4152-b665-28a66ada2181 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.377878 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fb0d4-d94d-4152-b665-28a66ada2181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.388135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f5c02-f04c-4b74-9f69-e0142d9ba1ab None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:55.400376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-019fb0d4-d94d-4152-b665-28a66ada2181 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:55.401923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-019fb0d4-d94d-4152-b665-28a66ada2181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.463970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af8095-8547-49e3-9f09-726c9e00df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:55.465168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8095-8547-49e3-9f09-726c9e00df66 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.465168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8095-8547-49e3-9f09-726c9e00df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.465384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8095-8547-49e3-9f09-726c9e00df66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.471777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 926/1834] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:55.474663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8095-8547-49e3-9f09-726c9e00df66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:55.475497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8095-8547-49e3-9f09-726c9e00df66 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:55.490663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fb0d4-d94d-4152-b665-28a66ada2181 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:55.493290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-019fb0d4-d94d-4152-b665-28a66ada2181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.578974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fb0d4-d94d-4152-b665-28a66ada2181 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:55.582680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dbe56-8b6c-48a3-a9d4-908129964571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:55.583609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dbe56-8b6c-48a3-a9d4-908129964571 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.583894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dbe56-8b6c-48a3-a9d4-908129964571 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.584176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dbe56-8b6c-48a3-a9d4-908129964571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.605154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 909/1835] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:55 2022] POST /identity/v3/projects => generated 381 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:55.611237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dbe56-8b6c-48a3-a9d4-908129964571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:55.611610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dbe56-8b6c-48a3-a9d4-908129964571 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:55.616181 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af8095-8547-49e3-9f09-726c9e00df66 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:55.630758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 927/1836] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:55.687253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af8095-8547-49e3-9f09-726c9e00df66 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:55.693082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5544df-6dd6-4222-ae8b-4f2dc3ee7065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:55.693698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5544df-6dd6-4222-ae8b-4f2dc3ee7065 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.693982 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5544df-6dd6-4222-ae8b-4f2dc3ee7065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.694258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5544df-6dd6-4222-ae8b-4f2dc3ee7065 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.694912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5544df-6dd6-4222-ae8b-4f2dc3ee7065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:55.696935 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5544df-6dd6-4222-ae8b-4f2dc3ee7065 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:55.860219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 910/1837] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:55 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:55.865754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dbe56-8b6c-48a3-a9d4-908129964571 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:55.880225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dbe56-8b6c-48a3-a9d4-908129964571 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:55.885636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48098d61-4d4f-4d89-b5af-14444cb441a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:55.886448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48098d61-4d4f-4d89-b5af-14444cb441a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.886734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48098d61-4d4f-4d89-b5af-14444cb441a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.887165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48098d61-4d4f-4d89-b5af-14444cb441a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.887824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48098d61-4d4f-4d89-b5af-14444cb441a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:55.890392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48098d61-4d4f-4d89-b5af-14444cb441a1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:55.916205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 928/1838] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:55.917600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5544df-6dd6-4222-ae8b-4f2dc3ee7065 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:55.930084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5544df-6dd6-4222-ae8b-4f2dc3ee7065 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:55.938973 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35f81e-9b40-4c49-a4aa-c4462e5ee7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:55.939710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35f81e-9b40-4c49-a4aa-c4462e5ee7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.939992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35f81e-9b40-4c49-a4aa-c4462e5ee7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.940272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35f81e-9b40-4c49-a4aa-c4462e5ee7ec admin admin] PATH_INFO: `/v3/projects/3401e7b2c2854fcbbd9594b9ffb66ba2/users/b143c0b06b664248a74dcdf4f604e8c0/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.973091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35f81e-9b40-4c49-a4aa-c4462e5ee7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3401e7b2c2854fcbbd9594b9ffb66ba2, user_id=b143c0b06b664248a74dcdf4f604e8c0, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:55.976213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35f81e-9b40-4c49-a4aa-c4462e5ee7ec admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.081562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 911/1839] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:55 2022] PUT /identity/v3/projects/3401e7b2c2854fcbbd9594b9ffb66ba2/users/b143c0b06b664248a74dcdf4f604e8c0/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:56.086588 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48098d61-4d4f-4d89-b5af-14444cb441a1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.097390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48098d61-4d4f-4d89-b5af-14444cb441a1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.167066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ca50e-e172-4a23-9748-49b4786104dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.167066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ca50e-e172-4a23-9748-49b4786104dd admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.167415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ca50e-e172-4a23-9748-49b4786104dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.167890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ca50e-e172-4a23-9748-49b4786104dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.168569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ca50e-e172-4a23-9748-49b4786104dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.170277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ca50e-e172-4a23-9748-49b4786104dd admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.190988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 929/1840] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:56.192675 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35f81e-9b40-4c49-a4aa-c4462e5ee7ec admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.204894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35f81e-9b40-4c49-a4aa-c4462e5ee7ec admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.211468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904896a-cc17-4431-a600-b08b87ad7e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.212133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904896a-cc17-4431-a600-b08b87ad7e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.212414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904896a-cc17-4431-a600-b08b87ad7e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.212693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904896a-cc17-4431-a600-b08b87ad7e19 admin admin] PATH_INFO: `/v3/projects/3401e7b2c2854fcbbd9594b9ffb66ba2/users/b143c0b06b664248a74dcdf4f604e8c0/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.215425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904896a-cc17-4431-a600-b08b87ad7e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3401e7b2c2854fcbbd9594b9ffb66ba2, user_id=b143c0b06b664248a74dcdf4f604e8c0, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.218290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904896a-cc17-4431-a600-b08b87ad7e19 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.233635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 912/1841] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:56 2022] PUT /identity/v3/projects/3401e7b2c2854fcbbd9594b9ffb66ba2/users/b143c0b06b664248a74dcdf4f604e8c0/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:56.244168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68b02-1298-4660-81c4-d30ec0c23780 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.244512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68b02-1298-4660-81c4-d30ec0c23780 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.244857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68b02-1298-4660-81c4-d30ec0c23780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.289475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-02b68b02-1298-4660-81c4-d30ec0c23780 None None] MFA Rules not processed for user `b143c0b06b664248a74dcdf4f604e8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:56.289475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-02b68b02-1298-4660-81c4-d30ec0c23780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.380727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 930/1842] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:56.393867 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904896a-cc17-4431-a600-b08b87ad7e19 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.397086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5904896a-cc17-4431-a600-b08b87ad7e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.435480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68b02-1298-4660-81c4-d30ec0c23780 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.437051 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-02b68b02-1298-4660-81c4-d30ec0c23780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.519161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:56.519161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904896a-cc17-4431-a600-b08b87ad7e19 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.521256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe114b9-58e5-45ea-ba24-779feb70f4b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.521886 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe114b9-58e5-45ea-ba24-779feb70f4b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.522168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe114b9-58e5-45ea-ba24-779feb70f4b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.523029 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe114b9-58e5-45ea-ba24-779feb70f4b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.536371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe114b9-58e5-45ea-ba24-779feb70f4b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.538219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe114b9-58e5-45ea-ba24-779feb70f4b6 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.564726 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 913/1843] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:56.569706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac30082-c2c4-40f4-b400-09e192c63190 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.570006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac30082-c2c4-40f4-b400-09e192c63190 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.572508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac30082-c2c4-40f4-b400-09e192c63190 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.574112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 914/1844] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:48:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:56.580813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68b02-1298-4660-81c4-d30ec0c23780 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.588136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.589736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.590041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.590655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] PATH_INFO: `/v3/users/29000808c6b2416f9eea85ec838d61b7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.593038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29000808c6b2416f9eea85ec838d61b7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.595951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.601526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5833c-993f-4c7e-88bb-7cafb0cdb8d8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.604317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5833c-993f-4c7e-88bb-7cafb0cdb8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.614075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5833c-993f-4c7e-88bb-7cafb0cdb8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.679981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b0b5833c-993f-4c7e-88bb-7cafb0cdb8d8 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:56.723371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b0b5833c-993f-4c7e-88bb-7cafb0cdb8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.786477 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 915/1845] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:48:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:56.899570 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5833c-993f-4c7e-88bb-7cafb0cdb8d8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.908609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b0b5833c-993f-4c7e-88bb-7cafb0cdb8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.947134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29000808c6b2416f9eea85ec838d61b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:56.947134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29000808c6b2416f9eea85ec838d61b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:56.947134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29000808c6b2416f9eea85ec838d61b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:56.965367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5833c-993f-4c7e-88bb-7cafb0cdb8d8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.971217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.972068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.973520 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.974103 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] PATH_INFO: `/v3/projects/f3390caa54ef48fe9208ed6dd117f89c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.975694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3390caa54ef48fe9208ed6dd117f89c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.979530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.172426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29000808c6b2416f9eea85ec838d61b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.192614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29000808c6b2416f9eea85ec838d61b7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.193640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3390caa54ef48fe9208ed6dd117f89c', 'request_id': 'req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.204719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3390caa54ef48fe9208ed6dd117f89c', 'request_id': 'req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.217582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 931/1846] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:56 2022] DELETE /identity/v3/users/29000808c6b2416f9eea85ec838d61b7 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:57.217582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.217582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.291906 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3390caa54ef48fe9208ed6dd117f89c', 'request_id': 'req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.293849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61affdf4-4987-4b79-a7c4-e52a4c5d2d91 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.300202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff00d79-bbf3-4f97-9ea9-6b42f91fc10d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.300864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff00d79-bbf3-4f97-9ea9-6b42f91fc10d service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.301147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff00d79-bbf3-4f97-9ea9-6b42f91fc10d service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.301425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff00d79-bbf3-4f97-9ea9-6b42f91fc10d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.303219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ff00d79-bbf3-4f97-9ea9-6b42f91fc10d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.304885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] The token cache is being invalidate because project f3390caa54ef48fe9208ed6dd117f89c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:57.305247 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.305927 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e3ee5ffa-9e94-4434-a109-e9331d4bbc7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.307793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 916/1847] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:56 2022] DELETE /identity/v3/projects/f3390caa54ef48fe9208ed6dd117f89c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:57.312453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8759b-e11b-445b-ae66-2c6cc978cc50 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.312750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8759b-e11b-445b-ae66-2c6cc978cc50 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.313031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8759b-e11b-445b-ae66-2c6cc978cc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.317192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff00d79-bbf3-4f97-9ea9-6b42f91fc10d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.318962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff00d79-bbf3-4f97-9ea9-6b42f91fc10d service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.329955 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 932/1848] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:57.330614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff00d79-bbf3-4f97-9ea9-6b42f91fc10d service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.332003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ff00d79-bbf3-4f97-9ea9-6b42f91fc10d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.342030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-79f8759b-e11b-445b-ae66-2c6cc978cc50 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:57.344058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-79f8759b-e11b-445b-ae66-2c6cc978cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.408063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 917/1849] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:57.410181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff00d79-bbf3-4f97-9ea9-6b42f91fc10d service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.415499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.416184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.416423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.416694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] PATH_INFO: `/v3/users/5ee2514924f944808a21134a2196880b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.417816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8759b-e11b-445b-ae66-2c6cc978cc50 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.417946 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee2514924f944808a21134a2196880b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.419559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-79f8759b-e11b-445b-ae66-2c6cc978cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.419890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.483564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8759b-e11b-445b-ae66-2c6cc978cc50 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.487502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696e461-929a-49ff-94d0-1731d4ba4140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.488191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696e461-929a-49ff-94d0-1731d4ba4140 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.488469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696e461-929a-49ff-94d0-1731d4ba4140 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.488745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696e461-929a-49ff-94d0-1731d4ba4140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.498182 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696e461-929a-49ff-94d0-1731d4ba4140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.499717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696e461-929a-49ff-94d0-1731d4ba4140 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.514719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 918/1850] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:57.721861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee2514924f944808a21134a2196880b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.723081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee2514924f944808a21134a2196880b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.723695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee2514924f944808a21134a2196880b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.829468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee2514924f944808a21134a2196880b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.853627 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee2514924f944808a21134a2196880b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.867096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 933/1851] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:57 2022] DELETE /identity/v3/users/5ee2514924f944808a21134a2196880b => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:57.973571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:58.061623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696e461-929a-49ff-94d0-1731d4ba4140 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.061623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b696e461-929a-49ff-94d0-1731d4ba4140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.063197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.064731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.139088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9abb-6e08-413a-9b3a-b54f8912f5d5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.145248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.146036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.146425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.146804 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] PATH_INFO: `/v3/projects/58cc435a96444b9a92d6dcbb3b35f3a6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.148338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] RBAC: Authorizing `identity:delete_project(project_id=58cc435a96444b9a92d6dcbb3b35f3a6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.150608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.213137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696e461-929a-49ff-94d0-1731d4ba4140 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.291006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58cc435a96444b9a92d6dcbb3b35f3a6', 'request_id': 'req-016ac20a-cc28-4f1a-9efa-06f5431fa62e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.307482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17158e8f-b04c-4682-93c3-101a2f6ecdc5 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b143c0b06b664248a74dcdf4f604e8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3401e7b2c2854fcbbd9594b9ffb66ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.308142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17158e8f-b04c-4682-93c3-101a2f6ecdc5 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.308428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17158e8f-b04c-4682-93c3-101a2f6ecdc5 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.308704 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17158e8f-b04c-4682-93c3-101a2f6ecdc5 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.309366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17158e8f-b04c-4682-93c3-101a2f6ecdc5 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:58.309677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17158e8f-b04c-4682-93c3-101a2f6ecdc5 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.311370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17158e8f-b04c-4682-93c3-101a2f6ecdc5 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.327324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 919/1852] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:58.333406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17158e8f-b04c-4682-93c3-101a2f6ecdc5 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.335156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-17158e8f-b04c-4682-93c3-101a2f6ecdc5 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.349937 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17158e8f-b04c-4682-93c3-101a2f6ecdc5 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.432933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898da796-5924-4d6c-bf6c-91b8b73d6287 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b143c0b06b664248a74dcdf4f604e8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3401e7b2c2854fcbbd9594b9ffb66ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.434020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898da796-5924-4d6c-bf6c-91b8b73d6287 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.434230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898da796-5924-4d6c-bf6c-91b8b73d6287 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.434533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898da796-5924-4d6c-bf6c-91b8b73d6287 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.435209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58cc435a96444b9a92d6dcbb3b35f3a6', 'request_id': 'req-016ac20a-cc28-4f1a-9efa-06f5431fa62e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.435700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898da796-5924-4d6c-bf6c-91b8b73d6287 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.437329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898da796-5924-4d6c-bf6c-91b8b73d6287 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.442305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58cc435a96444b9a92d6dcbb3b35f3a6', 'request_id': 'req-016ac20a-cc28-4f1a-9efa-06f5431fa62e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.460892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] The token cache is being invalidate because project 58cc435a96444b9a92d6dcbb3b35f3a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:58.461256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.461882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.465268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 934/1853] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:58 2022] DELETE /identity/v3/projects/58cc435a96444b9a92d6dcbb3b35f3a6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:58.468402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.470199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.554937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ac20a-cc28-4f1a-9efa-06f5431fa62e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.570494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.570494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.570494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.570494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] PATH_INFO: `/v3/users/6e4b11d62c0a4965b9d8e225c5838835` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.570923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4b11d62c0a4965b9d8e225c5838835)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.570923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.619875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 920/1854] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:58 2022] POST /identity/v3/projects => generated 354 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:58.624017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898da796-5924-4d6c-bf6c-91b8b73d6287 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.625604 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-898da796-5924-4d6c-bf6c-91b8b73d6287 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.692830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898da796-5924-4d6c-bf6c-91b8b73d6287 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.697856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bddc7c-d4e6-4a5e-8982-73b410cc3560 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b143c0b06b664248a74dcdf4f604e8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3401e7b2c2854fcbbd9594b9ffb66ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.698514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bddc7c-d4e6-4a5e-8982-73b410cc3560 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.698804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bddc7c-d4e6-4a5e-8982-73b410cc3560 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.699507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bddc7c-d4e6-4a5e-8982-73b410cc3560 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.699777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bddc7c-d4e6-4a5e-8982-73b410cc3560 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:58.700092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bddc7c-d4e6-4a5e-8982-73b410cc3560 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.701746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bddc7c-d4e6-4a5e-8982-73b410cc3560 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.713909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 921/1855] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:48:58.752224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bddc7c-d4e6-4a5e-8982-73b410cc3560 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.768017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bddc7c-d4e6-4a5e-8982-73b410cc3560 tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.774175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b143c0b06b664248a74dcdf4f604e8c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3401e7b2c2854fcbbd9594b9ffb66ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.774819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.775191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.775518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] PATH_INFO: `/v3/projects/d5683642a5a6486dabb52f8e7d7c2eac` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.776783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5683642a5a6486dabb52f8e7d7c2eac)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.778801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.941346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4b11d62c0a4965b9d8e225c5838835'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.941346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4b11d62c0a4965b9d8e225c5838835'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.941346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4b11d62c0a4965b9d8e225c5838835'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.008145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5683642a5a6486dabb52f8e7d7c2eac', 'request_id': 'req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.013733 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5683642a5a6486dabb52f8e7d7c2eac', 'request_id': 'req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.052513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4b11d62c0a4965b9d8e225c5838835'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.065327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4b11d62c0a4965b9d8e225c5838835'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.077590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 935/1856] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:58 2022] DELETE /identity/v3/users/6e4b11d62c0a4965b9d8e225c5838835 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:59.080612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:59.080612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:59.154678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83dcc9-64c6-4b10-9c74-b38946b1fc2b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:59.159564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:59.160941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:59.167552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:59.167552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] PATH_INFO: `/v3/projects/3dc8863f3e934301b5f44ac873d06e25` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:59.167552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc8863f3e934301b5f44ac873d06e25)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:59.167552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:59.189226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5683642a5a6486dabb52f8e7d7c2eac', 'request_id': 'req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.202543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] The token cache is being invalidate because project d5683642a5a6486dabb52f8e7d7c2eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:59.202837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.203515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ba1671a3-493d-4db0-bd67-4ecd94ca4b7d tempest-VolumeQuotaClassesTest-1762582309 tempest-VolumeQuotaClassesTest-1762582309-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.205015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 922/1857] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:58 2022] DELETE /identity/v3/projects/d5683642a5a6486dabb52f8e7d7c2eac => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:59.324637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc8863f3e934301b5f44ac873d06e25', 'request_id': 'req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.436204 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc8863f3e934301b5f44ac873d06e25', 'request_id': 'req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.444922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc8863f3e934301b5f44ac873d06e25', 'request_id': 'req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.456761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] The token cache is being invalidate because project 3dc8863f3e934301b5f44ac873d06e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:59.457133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.458135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed86d3b-0fba-401f-bea6-453fceb9d0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.459911 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 936/1858] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:59 2022] DELETE /identity/v3/projects/3dc8863f3e934301b5f44ac873d06e25 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:59.465245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8fb9d-c832-4618-b6b3-a0b18550ea75 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:59.465599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8fb9d-c832-4618-b6b3-a0b18550ea75 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:59.465946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8fb9d-c832-4618-b6b3-a0b18550ea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:59.486460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e2d8fb9d-c832-4618-b6b3-a0b18550ea75 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:59.487813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e2d8fb9d-c832-4618-b6b3-a0b18550ea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:59.549479 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 923/1859] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:59.562222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5520f0-9f47-42c4-aad2-079f2baad6a4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:59.562222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5520f0-9f47-42c4-aad2-079f2baad6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:59.562222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5520f0-9f47-42c4-aad2-079f2baad6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:59.611599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ef5520f0-9f47-42c4-aad2-079f2baad6a4 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:59.612851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ef5520f0-9f47-42c4-aad2-079f2baad6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:59.634268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 937/1860] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:59.643760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8fb9d-c832-4618-b6b3-a0b18550ea75 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:59.653674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8fb9d-c832-4618-b6b3-a0b18550ea75 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:59.658744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839c841-e58f-4992-934c-79b73d785d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:59.659443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839c841-e58f-4992-934c-79b73d785d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:59.659727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839c841-e58f-4992-934c-79b73d785d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:59.662260 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839c841-e58f-4992-934c-79b73d785d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:59.662260 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839c841-e58f-4992-934c-79b73d785d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:59.662260 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839c841-e58f-4992-934c-79b73d785d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:59.663168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839c841-e58f-4992-934c-79b73d785d8f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:59.676692 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 924/1861] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:59.681089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5520f0-9f47-42c4-aad2-079f2baad6a4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:59.691285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5520f0-9f47-42c4-aad2-079f2baad6a4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:59.697475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d60e1-7598-4fa6-8052-72efd2ba021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:59.698172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d60e1-7598-4fa6-8052-72efd2ba021d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:59.698531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d60e1-7598-4fa6-8052-72efd2ba021d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:59.698887 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d60e1-7598-4fa6-8052-72efd2ba021d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:59.699644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d60e1-7598-4fa6-8052-72efd2ba021d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:59.701757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d60e1-7598-4fa6-8052-72efd2ba021d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:59.741325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839c841-e58f-4992-934c-79b73d785d8f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:59.743920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0839c841-e58f-4992-934c-79b73d785d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:59.761196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839c841-e58f-4992-934c-79b73d785d8f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:59.766796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:59.768921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:59.768921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:59.768921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] PATH_INFO: `/v3/projects/5df2e9283577496cb0f44a485a8f0d41` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:59.769919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df2e9283577496cb0f44a485a8f0d41)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:59.772431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:59.866766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 938/1862] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:59 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:59.870945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d60e1-7598-4fa6-8052-72efd2ba021d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:59.935360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d60e1-7598-4fa6-8052-72efd2ba021d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:59.943894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74dbe9-2027-4ccf-8672-c077c40d6564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:59.943894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74dbe9-2027-4ccf-8672-c077c40d6564 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:59.943894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74dbe9-2027-4ccf-8672-c077c40d6564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:59.943894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74dbe9-2027-4ccf-8672-c077c40d6564 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:59.944334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74dbe9-2027-4ccf-8672-c077c40d6564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:59.945168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74dbe9-2027-4ccf-8672-c077c40d6564 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:59.991546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df2e9283577496cb0f44a485a8f0d41', 'request_id': 'req-259bca42-8e2e-4619-b7f9-7193e7f2ef97'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.996948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df2e9283577496cb0f44a485a8f0d41', 'request_id': 'req-259bca42-8e2e-4619-b7f9-7193e7f2ef97'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.064274 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df2e9283577496cb0f44a485a8f0d41', 'request_id': 'req-259bca42-8e2e-4619-b7f9-7193e7f2ef97'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.083873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 939/1863] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:59 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:00.085707 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74dbe9-2027-4ccf-8672-c077c40d6564 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.089833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0b74dbe9-2027-4ccf-8672-c077c40d6564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:00.091984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] The token cache is being invalidate because project 5df2e9283577496cb0f44a485a8f0d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:00.092295 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.094734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.097180 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 925/1864] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:59 2022] DELETE /identity/v3/projects/5df2e9283577496cb0f44a485a8f0d41 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:00.102297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.104149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:00.122971 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74dbe9-2027-4ccf-8672-c077c40d6564 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:00.222106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bca42-8e2e-4619-b7f9-7193e7f2ef97 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:00.224058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:00.224727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.225037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.225463 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] PATH_INFO: `/v3/users/44c3c73cb34949a79c2d828c2815abcc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.226871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c3c73cb34949a79c2d828c2815abcc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:00.228410 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229bcf2-1eaa-4d75-b221-0850903ad25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:00.234128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229bcf2-1eaa-4d75-b221-0850903ad25c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.234251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:00.234342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229bcf2-1eaa-4d75-b221-0850903ad25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.234342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229bcf2-1eaa-4d75-b221-0850903ad25c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.234342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229bcf2-1eaa-4d75-b221-0850903ad25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:00.234342 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229bcf2-1eaa-4d75-b221-0850903ad25c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:00.244429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 926/1865] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:00.245672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229bcf2-1eaa-4d75-b221-0850903ad25c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.248245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a229bcf2-1eaa-4d75-b221-0850903ad25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:00.265682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229bcf2-1eaa-4d75-b221-0850903ad25c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:00.273801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:00.274519 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.275952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.276235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] PATH_INFO: `/v3/users/e3ad1c7b01a74911b27ea5c1c54f2cdc` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.277493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ad1c7b01a74911b27ea5c1c54f2cdc)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:00.280037 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:00.607626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c3c73cb34949a79c2d828c2815abcc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.608305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c3c73cb34949a79c2d828c2815abcc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.609117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c3c73cb34949a79c2d828c2815abcc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.627877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ad1c7b01a74911b27ea5c1c54f2cdc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.760431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c3c73cb34949a79c2d828c2815abcc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.774467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c3c73cb34949a79c2d828c2815abcc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.787869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 940/1866] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:00 2022] DELETE /identity/v3/users/44c3c73cb34949a79c2d828c2815abcc => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:00.788725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.790109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:00.875594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebb15a-8a39-488a-9bb5-6e7113c6bc7f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:00.880855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10294e9-cd6d-4b7a-8320-2b27eab12f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:00.881476 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10294e9-cd6d-4b7a-8320-2b27eab12f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.881764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10294e9-cd6d-4b7a-8320-2b27eab12f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.882043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10294e9-cd6d-4b7a-8320-2b27eab12f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.882706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10294e9-cd6d-4b7a-8320-2b27eab12f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:00.884481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10294e9-cd6d-4b7a-8320-2b27eab12f12 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:00.896120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 941/1867] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:00.897526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6369-ba75-41d7-aa1d-86b09b3ff153 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.897815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6369-ba75-41d7-aa1d-86b09b3ff153 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.898125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6369-ba75-41d7-aa1d-86b09b3ff153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.907871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ad1c7b01a74911b27ea5c1c54f2cdc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.917628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ad1c7b01a74911b27ea5c1c54f2cdc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.918278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ad1c7b01a74911b27ea5c1c54f2cdc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.919767 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b7eb6369-ba75-41d7-aa1d-86b09b3ff153 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:00.921185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b7eb6369-ba75-41d7-aa1d-86b09b3ff153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:00.931019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 942/1868] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:00.932011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6369-ba75-41d7-aa1d-86b09b3ff153 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.933386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b7eb6369-ba75-41d7-aa1d-86b09b3ff153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:00.935394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ad1c7b01a74911b27ea5c1c54f2cdc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.943514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 927/1869] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:00 2022] DELETE /identity/v3/users/e3ad1c7b01a74911b27ea5c1c54f2cdc => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:00.947847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.947847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:00.948025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6369-ba75-41d7-aa1d-86b09b3ff153 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.022150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e199aa-cafe-4cd0-a616-b983aa8ea72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.028215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e199aa-cafe-4cd0-a616-b983aa8ea72b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.028215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e199aa-cafe-4cd0-a616-b983aa8ea72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.028215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e199aa-cafe-4cd0-a616-b983aa8ea72b admin admin] PATH_INFO: `/v3/projects/f04cdfbb7f7a49e596da4797c7a18739/users/9f9efe304bbf484f8d1bbeebe2b6e469/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.034514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde5abf-f88d-4c69-96c4-1591d9259faf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.038559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67743070-8e5e-445a-9957-1bcd12a5091a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.039211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743070-8e5e-445a-9957-1bcd12a5091a service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.039500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743070-8e5e-445a-9957-1bcd12a5091a service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.039777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743070-8e5e-445a-9957-1bcd12a5091a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.044347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e199aa-cafe-4cd0-a616-b983aa8ea72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04cdfbb7f7a49e596da4797c7a18739, user_id=9f9efe304bbf484f8d1bbeebe2b6e469, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.047313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e199aa-cafe-4cd0-a616-b983aa8ea72b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.050588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67743070-8e5e-445a-9957-1bcd12a5091a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.051904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67743070-8e5e-445a-9957-1bcd12a5091a service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.062038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 928/1870] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:01.161108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 943/1871] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:00 2022] PUT /identity/v3/projects/f04cdfbb7f7a49e596da4797c7a18739/users/9f9efe304bbf484f8d1bbeebe2b6e469/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:01.172474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e386529-ac8b-4093-abeb-b4ced770b42e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.172778 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e386529-ac8b-4093-abeb-b4ced770b42e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.173131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e386529-ac8b-4093-abeb-b4ced770b42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.202025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0e386529-ac8b-4093-abeb-b4ced770b42e None None] MFA Rules not processed for user `9f9efe304bbf484f8d1bbeebe2b6e469`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:01.203299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0e386529-ac8b-4093-abeb-b4ced770b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:01.303495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 929/1872] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:01.307971 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e199aa-cafe-4cd0-a616-b983aa8ea72b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.405974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e199aa-cafe-4cd0-a616-b983aa8ea72b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.411981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489af138-8e6c-415f-979b-e4167d90c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.412774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489af138-8e6c-415f-979b-e4167d90c961 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.413517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489af138-8e6c-415f-979b-e4167d90c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.413893 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489af138-8e6c-415f-979b-e4167d90c961 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.414662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489af138-8e6c-415f-979b-e4167d90c961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.417296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489af138-8e6c-415f-979b-e4167d90c961 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.517325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e386529-ac8b-4093-abeb-b4ced770b42e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.518793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0e386529-ac8b-4093-abeb-b4ced770b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:01.532453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e386529-ac8b-4093-abeb-b4ced770b42e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.536699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 944/1873] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:01 2022] POST /identity/v3/projects => generated 391 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:01.537062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.545253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.545253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.545253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] PATH_INFO: `/v3/projects/ac748079367848858df8e14ef0aae7cd` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.545253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac748079367848858df8e14ef0aae7cd)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.545253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.559341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489af138-8e6c-415f-979b-e4167d90c961 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.665511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489af138-8e6c-415f-979b-e4167d90c961 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.665511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c4ec-541a-4c1b-8b98-726c216361e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.665511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c4ec-541a-4c1b-8b98-726c216361e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.665511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c4ec-541a-4c1b-8b98-726c216361e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.666395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c4ec-541a-4c1b-8b98-726c216361e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.666395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2c4ec-541a-4c1b-8b98-726c216361e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.666997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2c4ec-541a-4c1b-8b98-726c216361e6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.728022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac748079367848858df8e14ef0aae7cd', 'request_id': 'req-70975569-a081-484d-b9bb-4046e4f39e47'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.734300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac748079367848858df8e14ef0aae7cd', 'request_id': 'req-70975569-a081-484d-b9bb-4046e4f39e47'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.864196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac748079367848858df8e14ef0aae7cd', 'request_id': 'req-70975569-a081-484d-b9bb-4046e4f39e47'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.877690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 945/1874] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:01 2022] POST /identity/v3/users => generated 302 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:01.877690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c4ec-541a-4c1b-8b98-726c216361e6 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.878447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-80a2c4ec-541a-4c1b-8b98-726c216361e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:01.879876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] The token cache is being invalidate because project ac748079367848858df8e14ef0aae7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:01.880177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.880954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.884478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 930/1875] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:01 2022] DELETE /identity/v3/projects/ac748079367848858df8e14ef0aae7cd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:01.885457 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.889558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:01.905231 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c4ec-541a-4c1b-8b98-726c216361e6 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.963928 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70975569-a081-484d-b9bb-4046e4f39e47 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.970321 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352512f6-61a0-45ef-94c8-a4cefe22b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.971254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352512f6-61a0-45ef-94c8-a4cefe22b4df admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.971254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352512f6-61a0-45ef-94c8-a4cefe22b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.971545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352512f6-61a0-45ef-94c8-a4cefe22b4df admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.972208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352512f6-61a0-45ef-94c8-a4cefe22b4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.974357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352512f6-61a0-45ef-94c8-a4cefe22b4df admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.985789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 931/1876] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:01.987545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb2dfc-2edf-4f78-9f50-8611ebf33648 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.987838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb2dfc-2edf-4f78-9f50-8611ebf33648 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.988147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb2dfc-2edf-4f78-9f50-8611ebf33648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.990670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.991478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.992019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.992307 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] PATH_INFO: `/v3/projects/f263e537075b47cc88eafe89fcdf58cf` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.993928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f263e537075b47cc88eafe89fcdf58cf)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.996741 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.012250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-79cb2dfc-2edf-4f78-9f50-8611ebf33648 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:02.013509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-79cb2dfc-2edf-4f78-9f50-8611ebf33648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:02.030851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 932/1877] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:02.030851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb2dfc-2edf-4f78-9f50-8611ebf33648 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.038128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb2dfc-2edf-4f78-9f50-8611ebf33648 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.047855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbe13c-e87d-4a77-b378-9b44d3e9b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.047855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe13c-e87d-4a77-b378-9b44d3e9b7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.048351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe13c-e87d-4a77-b378-9b44d3e9b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.048490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe13c-e87d-4a77-b378-9b44d3e9b7d0 admin admin] PATH_INFO: `/v3/projects/b2e7ad298c7e47269ce1439ffb3af49b/users/52f9a274830f4c6d965139f4af1632de/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.071493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbe13c-e87d-4a77-b378-9b44d3e9b7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e7ad298c7e47269ce1439ffb3af49b, user_id=52f9a274830f4c6d965139f4af1632de, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.074512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbe13c-e87d-4a77-b378-9b44d3e9b7d0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.185132 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 933/1878] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:02 2022] PUT /identity/v3/projects/b2e7ad298c7e47269ce1439ffb3af49b/users/52f9a274830f4c6d965139f4af1632de/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:02.190106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa266-47c6-4e22-a2d1-0430a6a0135b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.190470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa266-47c6-4e22-a2d1-0430a6a0135b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.190850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa266-47c6-4e22-a2d1-0430a6a0135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.194468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f263e537075b47cc88eafe89fcdf58cf', 'request_id': 'req-a7acccf2-4b92-4d72-a6f3-952a617aba91'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:02.212060 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-27caa266-47c6-4e22-a2d1-0430a6a0135b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:02.213304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-27caa266-47c6-4e22-a2d1-0430a6a0135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:02.277884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 934/1879] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:02.278835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caa266-47c6-4e22-a2d1-0430a6a0135b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.289486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caa266-47c6-4e22-a2d1-0430a6a0135b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.294796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0811261-0c3b-4204-b808-cd2302aa62b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.295451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811261-0c3b-4204-b808-cd2302aa62b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.295768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811261-0c3b-4204-b808-cd2302aa62b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.296013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0811261-0c3b-4204-b808-cd2302aa62b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.296678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0811261-0c3b-4204-b808-cd2302aa62b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.298305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0811261-0c3b-4204-b808-cd2302aa62b9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.310599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 935/1880] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:02.313485 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0811261-0c3b-4204-b808-cd2302aa62b9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.314603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f263e537075b47cc88eafe89fcdf58cf', 'request_id': 'req-a7acccf2-4b92-4d72-a6f3-952a617aba91'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:02.322000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f263e537075b47cc88eafe89fcdf58cf', 'request_id': 'req-a7acccf2-4b92-4d72-a6f3-952a617aba91'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:02.344872 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0811261-0c3b-4204-b808-cd2302aa62b9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.345255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] The token cache is being invalidate because project f263e537075b47cc88eafe89fcdf58cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:02.345561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:02.346617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:02.349839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 946/1881] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:01 2022] DELETE /identity/v3/projects/f263e537075b47cc88eafe89fcdf58cf => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:02.350667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.351774 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16af3d1-51c5-44cc-ad4c-6a8bd5eedb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.352262 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16af3d1-51c5-44cc-ad4c-6a8bd5eedb70 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.352984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16af3d1-51c5-44cc-ad4c-6a8bd5eedb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.353391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16af3d1-51c5-44cc-ad4c-6a8bd5eedb70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.354199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16af3d1-51c5-44cc-ad4c-6a8bd5eedb70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:02.354396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:02.355408 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16af3d1-51c5-44cc-ad4c-6a8bd5eedb70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.357487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16af3d1-51c5-44cc-ad4c-6a8bd5eedb70 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.369273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acccf2-4b92-4d72-a6f3-952a617aba91 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.383920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 936/1882] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:02.385092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16af3d1-51c5-44cc-ad4c-6a8bd5eedb70 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.386865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e16af3d1-51c5-44cc-ad4c-6a8bd5eedb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:02.391384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb051d-924b-4d65-a5b0-33c6e05dd4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.392115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb051d-924b-4d65-a5b0-33c6e05dd4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.392395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb051d-924b-4d65-a5b0-33c6e05dd4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.392868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb051d-924b-4d65-a5b0-33c6e05dd4c1 admin admin] PATH_INFO: `/v3/projects/b2e7ad298c7e47269ce1439ffb3af49b/users/52f9a274830f4c6d965139f4af1632de/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.394818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb051d-924b-4d65-a5b0-33c6e05dd4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e7ad298c7e47269ce1439ffb3af49b, user_id=52f9a274830f4c6d965139f4af1632de, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.397509 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb051d-924b-4d65-a5b0-33c6e05dd4c1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.400240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16af3d1-51c5-44cc-ad4c-6a8bd5eedb70 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.405881 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.406522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.406850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.409285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] PATH_INFO: `/v3/users/b143c0b06b664248a74dcdf4f604e8c0` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.409285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b143c0b06b664248a74dcdf4f604e8c0)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.409449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 947/1883] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:02 2022] PUT /identity/v3/projects/b2e7ad298c7e47269ce1439ffb3af49b/users/52f9a274830f4c6d965139f4af1632de/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:02.409806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb051d-924b-4d65-a5b0-33c6e05dd4c1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.410584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.435980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-abbb051d-924b-4d65-a5b0-33c6e05dd4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:02.521148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:02.534413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb051d-924b-4d65-a5b0-33c6e05dd4c1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.539839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbccbeb-0f22-4449-a918-17a5addee52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.540456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbccbeb-0f22-4449-a918-17a5addee52b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.540737 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbccbeb-0f22-4449-a918-17a5addee52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.541014 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbccbeb-0f22-4449-a918-17a5addee52b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.541644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbccbeb-0f22-4449-a918-17a5addee52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.543617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbccbeb-0f22-4449-a918-17a5addee52b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.671944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 948/1884] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:02 2022] POST /identity/v3/projects => generated 383 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:02.673429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ac7fc-31a9-4f90-8267-3369fb0a5ce3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.674814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ac7fc-31a9-4f90-8267-3369fb0a5ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.674926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ac7fc-31a9-4f90-8267-3369fb0a5ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.710894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f76ac7fc-31a9-4f90-8267-3369fb0a5ce3 None None] MFA Rules not processed for user `52f9a274830f4c6d965139f4af1632de`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:02.712582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f76ac7fc-31a9-4f90-8267-3369fb0a5ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:02.716427 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b143c0b06b664248a74dcdf4f604e8c0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:02.801306 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 949/1885] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:02.802398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ac7fc-31a9-4f90-8267-3369fb0a5ce3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.811964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b143c0b06b664248a74dcdf4f604e8c0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:02.823148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b143c0b06b664248a74dcdf4f604e8c0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:02.826329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b143c0b06b664248a74dcdf4f604e8c0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:02.841566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b143c0b06b664248a74dcdf4f604e8c0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:02.851983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 937/1886] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:02 2022] DELETE /identity/v3/users/b143c0b06b664248a74dcdf4f604e8c0 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:02.852919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.854322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:02.881066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:02.896471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ac7fc-31a9-4f90-8267-3369fb0a5ce3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.940568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e1d9-2280-4f71-a5f2-70bee2bfd9c0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.973241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701139e-717c-464b-a693-712c0fcb0e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.974107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701139e-717c-464b-a693-712c0fcb0e5d service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.974393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701139e-717c-464b-a693-712c0fcb0e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.974931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701139e-717c-464b-a693-712c0fcb0e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.978532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4701139e-717c-464b-a693-712c0fcb0e5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:02.982302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d743ce-7b0b-4311-912f-08555d357ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.984211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d743ce-7b0b-4311-912f-08555d357ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.984723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d743ce-7b0b-4311-912f-08555d357ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.985216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d743ce-7b0b-4311-912f-08555d357ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.986261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d743ce-7b0b-4311-912f-08555d357ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.989051 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d743ce-7b0b-4311-912f-08555d357ce0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.059807 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701139e-717c-464b-a693-712c0fcb0e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.061306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701139e-717c-464b-a693-712c0fcb0e5d service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.072524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 938/1887] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:03.118783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 950/1888] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:02 2022] POST /identity/v3/users => generated 292 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:03.122217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701139e-717c-464b-a693-712c0fcb0e5d service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.124041 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4701139e-717c-464b-a693-712c0fcb0e5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.128930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d743ce-7b0b-4311-912f-08555d357ce0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.130840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-08d743ce-7b0b-4311-912f-08555d357ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.138739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701139e-717c-464b-a693-712c0fcb0e5d service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.145244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d743ce-7b0b-4311-912f-08555d357ce0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.150215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecffcf-6c4a-4fad-b0d2-6a3ebfc8e9b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.151617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecffcf-6c4a-4fad-b0d2-6a3ebfc8e9b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.151617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecffcf-6c4a-4fad-b0d2-6a3ebfc8e9b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.151617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecffcf-6c4a-4fad-b0d2-6a3ebfc8e9b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.159431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d6ecffcf-6c4a-4fad-b0d2-6a3ebfc8e9b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.164983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fd9ce-6099-46e1-b963-ee153a8382cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.166779 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd9ce-6099-46e1-b963-ee153a8382cd admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.167808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd9ce-6099-46e1-b963-ee153a8382cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.168468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd9ce-6099-46e1-b963-ee153a8382cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.169678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fd9ce-6099-46e1-b963-ee153a8382cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.173135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fd9ce-6099-46e1-b963-ee153a8382cd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.193062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 939/1889] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:03.194618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fd9ce-6099-46e1-b963-ee153a8382cd admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.210131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fd9ce-6099-46e1-b963-ee153a8382cd admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.216363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4aef3-e01a-406c-801f-d90e3128a82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.217926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4aef3-e01a-406c-801f-d90e3128a82c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.217926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4aef3-e01a-406c-801f-d90e3128a82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.217926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4aef3-e01a-406c-801f-d90e3128a82c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.218599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4aef3-e01a-406c-801f-d90e3128a82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.220791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4aef3-e01a-406c-801f-d90e3128a82c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.241106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 940/1890] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:03.242344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4aef3-e01a-406c-801f-d90e3128a82c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.252517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecffcf-6c4a-4fad-b0d2-6a3ebfc8e9b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.255257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4aef3-e01a-406c-801f-d90e3128a82c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.256654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecffcf-6c4a-4fad-b0d2-6a3ebfc8e9b9 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.260514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6c1eb-b52e-48ba-9767-3ea5ca00adb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.261823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6c1eb-b52e-48ba-9767-3ea5ca00adb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.262175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6c1eb-b52e-48ba-9767-3ea5ca00adb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.262522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6c1eb-b52e-48ba-9767-3ea5ca00adb9 admin admin] PATH_INFO: `/v3/projects/8d995605b5b248188b22e00607a379d3/users/435207fce2bf42fbb5dce6998e2127c6/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.273231 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 951/1891] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:03.286001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6c1eb-b52e-48ba-9767-3ea5ca00adb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d995605b5b248188b22e00607a379d3, user_id=435207fce2bf42fbb5dce6998e2127c6, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.288793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6c1eb-b52e-48ba-9767-3ea5ca00adb9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.435012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 941/1892] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:03 2022] PUT /identity/v3/projects/8d995605b5b248188b22e00607a379d3/users/435207fce2bf42fbb5dce6998e2127c6/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:03.437965 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9540e-b5f0-4881-85d8-e2c862d0109a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.438487 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9540e-b5f0-4881-85d8-e2c862d0109a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.439599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9540e-b5f0-4881-85d8-e2c862d0109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.460978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6c1eb-b52e-48ba-9767-3ea5ca00adb9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.464109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b6f6c1eb-b52e-48ba-9767-3ea5ca00adb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.476446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-96c9540e-b5f0-4881-85d8-e2c862d0109a None None] MFA Rules not processed for user `435207fce2bf42fbb5dce6998e2127c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:03.477843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96c9540e-b5f0-4881-85d8-e2c862d0109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.568748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 952/1893] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:03.568936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6c1eb-b52e-48ba-9767-3ea5ca00adb9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.569542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9540e-b5f0-4881-85d8-e2c862d0109a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.573758 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.574469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.574741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.575026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] PATH_INFO: `/v3/projects/3401e7b2c2854fcbbd9594b9ffb66ba2` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.576222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3401e7b2c2854fcbbd9594b9ffb66ba2)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.578333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.581505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9540e-b5f0-4881-85d8-e2c862d0109a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.587538 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8681fb1-3a55-459c-a2d0-05c057dc4cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.589600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8681fb1-3a55-459c-a2d0-05c057dc4cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.589600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8681fb1-3a55-459c-a2d0-05c057dc4cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.589600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8681fb1-3a55-459c-a2d0-05c057dc4cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.589600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8681fb1-3a55-459c-a2d0-05c057dc4cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.591421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8681fb1-3a55-459c-a2d0-05c057dc4cd4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.721689 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 953/1894] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:03 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:03.724148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8681fb1-3a55-459c-a2d0-05c057dc4cd4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.739574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3401e7b2c2854fcbbd9594b9ffb66ba2', 'request_id': 'req-078bb062-51cc-414b-b93f-949eed3e5d03'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.749265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3401e7b2c2854fcbbd9594b9ffb66ba2', 'request_id': 'req-078bb062-51cc-414b-b93f-949eed3e5d03'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.835033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8681fb1-3a55-459c-a2d0-05c057dc4cd4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.840548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955cd3d-3336-452f-a179-21aac413a4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.841739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955cd3d-3336-452f-a179-21aac413a4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.842033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955cd3d-3336-452f-a179-21aac413a4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.842314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955cd3d-3336-452f-a179-21aac413a4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.843559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955cd3d-3336-452f-a179-21aac413a4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.845551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955cd3d-3336-452f-a179-21aac413a4a4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.908958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3401e7b2c2854fcbbd9594b9ffb66ba2', 'request_id': 'req-078bb062-51cc-414b-b93f-949eed3e5d03'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.923327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] The token cache is being invalidate because project 3401e7b2c2854fcbbd9594b9ffb66ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:03.928025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.928025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-078bb062-51cc-414b-b93f-949eed3e5d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.928025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 942/1895] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:03 2022] DELETE /identity/v3/projects/3401e7b2c2854fcbbd9594b9ffb66ba2 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:03.931373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48b8b5-5567-4627-80cd-35b77de144d4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.931681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48b8b5-5567-4627-80cd-35b77de144d4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.931951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48b8b5-5567-4627-80cd-35b77de144d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.951664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ee48b8b5-5567-4627-80cd-35b77de144d4 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:03.952893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ee48b8b5-5567-4627-80cd-35b77de144d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.961247 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 943/1896] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:03.969119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c687-3f77-4a13-9aff-9882fa0b26c6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.969406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c687-3f77-4a13-9aff-9882fa0b26c6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.969682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1c687-3f77-4a13-9aff-9882fa0b26c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.990352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3ab1c687-3f77-4a13-9aff-9882fa0b26c6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:03.991618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3ab1c687-3f77-4a13-9aff-9882fa0b26c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.010630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 944/1897] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:04.043252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1c687-3f77-4a13-9aff-9882fa0b26c6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.043252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1c687-3f77-4a13-9aff-9882fa0b26c6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.046304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad63766-52e0-4f7d-a60c-626abfe6fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.051450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad63766-52e0-4f7d-a60c-626abfe6fd73 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.051838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad63766-52e0-4f7d-a60c-626abfe6fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.052198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad63766-52e0-4f7d-a60c-626abfe6fd73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.053484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad63766-52e0-4f7d-a60c-626abfe6fd73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:04.054925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad63766-52e0-4f7d-a60c-626abfe6fd73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.057399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad63766-52e0-4f7d-a60c-626abfe6fd73 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.083002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 945/1898] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:04.087502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad63766-52e0-4f7d-a60c-626abfe6fd73 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.101794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad63766-52e0-4f7d-a60c-626abfe6fd73 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.109676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 954/1899] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:03 2022] POST /identity/v3/users => generated 297 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:04.111119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955cd3d-3336-452f-a179-21aac413a4a4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.114455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b955cd3d-3336-452f-a179-21aac413a4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.117833 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5e095-f8b2-4e65-8528-d7f95cf4b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.118713 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e095-f8b2-4e65-8528-d7f95cf4b8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.118713 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e095-f8b2-4e65-8528-d7f95cf4b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.118964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e095-f8b2-4e65-8528-d7f95cf4b8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.119634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5e095-f8b2-4e65-8528-d7f95cf4b8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.121559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5e095-f8b2-4e65-8528-d7f95cf4b8d5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.132096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955cd3d-3336-452f-a179-21aac413a4a4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.142499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4a37-6729-4254-86b8-a701450d9071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.145575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4a37-6729-4254-86b8-a701450d9071 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.146131 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4a37-6729-4254-86b8-a701450d9071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.146524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d4a37-6729-4254-86b8-a701450d9071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.148315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d4a37-6729-4254-86b8-a701450d9071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.151139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d4a37-6729-4254-86b8-a701450d9071 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.170863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 955/1900] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:04.172039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4a37-6729-4254-86b8-a701450d9071 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.192178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d4a37-6729-4254-86b8-a701450d9071 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.197381 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc8784-7561-4b50-b171-58f893303f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.198128 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc8784-7561-4b50-b171-58f893303f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.198334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc8784-7561-4b50-b171-58f893303f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.198656 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc8784-7561-4b50-b171-58f893303f73 admin admin] PATH_INFO: `/v3/projects/c4bcd5c03f92415bb971a863182ced12/users/2158f4bcb2434b19bf68f860fe0bec8f/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.217417 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc8784-7561-4b50-b171-58f893303f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bcd5c03f92415bb971a863182ced12, user_id=2158f4bcb2434b19bf68f860fe0bec8f, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.220160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc8784-7561-4b50-b171-58f893303f73 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.475251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 956/1901] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:04 2022] PUT /identity/v3/projects/c4bcd5c03f92415bb971a863182ced12/users/2158f4bcb2434b19bf68f860fe0bec8f/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:04.487669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 946/1902] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:04 2022] POST /identity/v3/projects => generated 399 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:04.489426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc8784-7561-4b50-b171-58f893303f73 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.490674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5e095-f8b2-4e65-8528-d7f95cf4b8d5 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.568055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc8784-7561-4b50-b171-58f893303f73 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.573046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5e095-f8b2-4e65-8528-d7f95cf4b8d5 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.575810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6566c5-c4a3-47ea-95b2-19249325228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.577149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6566c5-c4a3-47ea-95b2-19249325228e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.577149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6566c5-c4a3-47ea-95b2-19249325228e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.577346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6566c5-c4a3-47ea-95b2-19249325228e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.578108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6566c5-c4a3-47ea-95b2-19249325228e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.580581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6566c5-c4a3-47ea-95b2-19249325228e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.598452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb7f1c-8e15-4cba-b87e-cb2f2d095bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.601588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb7f1c-8e15-4cba-b87e-cb2f2d095bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.601588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb7f1c-8e15-4cba-b87e-cb2f2d095bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.601588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb7f1c-8e15-4cba-b87e-cb2f2d095bdb admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.602353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb7f1c-8e15-4cba-b87e-cb2f2d095bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.607531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb7f1c-8e15-4cba-b87e-cb2f2d095bdb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.626354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 957/1903] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:04.629455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6566c5-c4a3-47ea-95b2-19249325228e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.662499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6566c5-c4a3-47ea-95b2-19249325228e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.676097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a4772-d154-45dd-9a84-98b5c2c25aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.677049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4772-d154-45dd-9a84-98b5c2c25aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.677658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4772-d154-45dd-9a84-98b5c2c25aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.678202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4772-d154-45dd-9a84-98b5c2c25aa5 admin admin] PATH_INFO: `/v3/projects/c4bcd5c03f92415bb971a863182ced12/users/2158f4bcb2434b19bf68f860fe0bec8f/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.680378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a4772-d154-45dd-9a84-98b5c2c25aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bcd5c03f92415bb971a863182ced12, user_id=2158f4bcb2434b19bf68f860fe0bec8f, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.683721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a4772-d154-45dd-9a84-98b5c2c25aa5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.707104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 958/1904] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:04 2022] PUT /identity/v3/projects/c4bcd5c03f92415bb971a863182ced12/users/2158f4bcb2434b19bf68f860fe0bec8f/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:04.715670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b3a6b-e102-407d-bcac-be2ec8a12fb7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.716023 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b3a6b-e102-407d-bcac-be2ec8a12fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.716306 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b3a6b-e102-407d-bcac-be2ec8a12fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.750886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f01b3a6b-e102-407d-bcac-be2ec8a12fb7 None None] MFA Rules not processed for user `2158f4bcb2434b19bf68f860fe0bec8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:04.752510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f01b3a6b-e102-407d-bcac-be2ec8a12fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.836924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 959/1905] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:04.849621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b3a6b-e102-407d-bcac-be2ec8a12fb7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.851547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f01b3a6b-e102-407d-bcac-be2ec8a12fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.860215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 947/1906] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:04 2022] POST /identity/v3/users => generated 300 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:04.871689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb7f1c-8e15-4cba-b87e-cb2f2d095bdb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.887837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb7f1c-8e15-4cba-b87e-cb2f2d095bdb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.938441 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b3a6b-e102-407d-bcac-be2ec8a12fb7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.944903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021db30-3ec3-415b-92cc-f68084f1e2bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.945709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021db30-3ec3-415b-92cc-f68084f1e2bb service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.946133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021db30-3ec3-415b-92cc-f68084f1e2bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.946543 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021db30-3ec3-415b-92cc-f68084f1e2bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.960266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021db30-3ec3-415b-92cc-f68084f1e2bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.962489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021db30-3ec3-415b-92cc-f68084f1e2bb service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.983423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c3857-588f-408b-8257-bbd52b141824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.984937 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c3857-588f-408b-8257-bbd52b141824 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.985461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c3857-588f-408b-8257-bbd52b141824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.985999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c3857-588f-408b-8257-bbd52b141824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.986962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c3857-588f-408b-8257-bbd52b141824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.990189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c3857-588f-408b-8257-bbd52b141824 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.990693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 960/1907] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:05.007103 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 948/1908] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:05.007253 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021db30-3ec3-415b-92cc-f68084f1e2bb service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.019601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021db30-3ec3-415b-92cc-f68084f1e2bb service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.024854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759de53-0a6e-4457-919f-59b31e0170ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.025480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759de53-0a6e-4457-919f-59b31e0170ec admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.025766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759de53-0a6e-4457-919f-59b31e0170ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.026214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759de53-0a6e-4457-919f-59b31e0170ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.027080 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759de53-0a6e-4457-919f-59b31e0170ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.028719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759de53-0a6e-4457-919f-59b31e0170ec admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.045459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 961/1909] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:05.049885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c3857-588f-408b-8257-bbd52b141824 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.062368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c3857-588f-408b-8257-bbd52b141824 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.069255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c03a1d-f85e-4c7e-a713-940762f76790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.070147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c03a1d-f85e-4c7e-a713-940762f76790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.070359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c03a1d-f85e-4c7e-a713-940762f76790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.070711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c03a1d-f85e-4c7e-a713-940762f76790 admin admin] PATH_INFO: `/v3/projects/6dced82cdd834cc0a6869f506b409184/users/c0378bcedba543adb4c40968a961a458/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.089741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c03a1d-f85e-4c7e-a713-940762f76790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dced82cdd834cc0a6869f506b409184, user_id=c0378bcedba543adb4c40968a961a458, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.092798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c03a1d-f85e-4c7e-a713-940762f76790 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.170798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759de53-0a6e-4457-919f-59b31e0170ec admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.182727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759de53-0a6e-4457-919f-59b31e0170ec admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.197510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d2af1-9749-4dbb-b9e9-a726900feb7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.198260 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d2af1-9749-4dbb-b9e9-a726900feb7b service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.198571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d2af1-9749-4dbb-b9e9-a726900feb7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.199011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d2af1-9749-4dbb-b9e9-a726900feb7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.202139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f63d2af1-9749-4dbb-b9e9-a726900feb7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.222477 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 949/1910] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:05 2022] PUT /identity/v3/projects/6dced82cdd834cc0a6869f506b409184/users/c0378bcedba543adb4c40968a961a458/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:05.254399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928488a-16b5-4a6c-9487-49d3721f0497 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.254707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928488a-16b5-4a6c-9487-49d3721f0497 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.254982 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928488a-16b5-4a6c-9487-49d3721f0497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.271280 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d2af1-9749-4dbb-b9e9-a726900feb7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.272750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d2af1-9749-4dbb-b9e9-a726900feb7b service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.282320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 962/1911] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:05.286455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5928488a-16b5-4a6c-9487-49d3721f0497 None None] MFA Rules not processed for user `c0378bcedba543adb4c40968a961a458`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:05.288080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5928488a-16b5-4a6c-9487-49d3721f0497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.385600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 950/1912] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:05.390263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d2af1-9749-4dbb-b9e9-a726900feb7b service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.402127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d2af1-9749-4dbb-b9e9-a726900feb7b service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.484030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326426d-f7dc-4ba3-843f-675527c98118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.490681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326426d-f7dc-4ba3-843f-675527c98118 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.490681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326426d-f7dc-4ba3-843f-675527c98118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.490681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326426d-f7dc-4ba3-843f-675527c98118 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.490681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326426d-f7dc-4ba3-843f-675527c98118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.490681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326426d-f7dc-4ba3-843f-675527c98118 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.642274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 963/1913] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:05 2022] POST /identity/v3/projects => generated 401 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:05.644600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928488a-16b5-4a6c-9487-49d3721f0497 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.657440 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928488a-16b5-4a6c-9487-49d3721f0497 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.695270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:05.762932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7bcca-16b3-48f0-a509-aaf0a5d04119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.763907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7bcca-16b3-48f0-a509-aaf0a5d04119 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.764363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7bcca-16b3-48f0-a509-aaf0a5d04119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.764757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7bcca-16b3-48f0-a509-aaf0a5d04119 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.765507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7bcca-16b3-48f0-a509-aaf0a5d04119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.767896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7bcca-16b3-48f0-a509-aaf0a5d04119 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.904981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 951/1914] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:05 2022] POST /identity/v3/users => generated 307 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:05.906230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326426d-f7dc-4ba3-843f-675527c98118 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.936746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326426d-f7dc-4ba3-843f-675527c98118 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.950052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3c299-0651-4e2e-b66c-cf30be217457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.950966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3c299-0651-4e2e-b66c-cf30be217457 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.951437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3c299-0651-4e2e-b66c-cf30be217457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.951877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3c299-0651-4e2e-b66c-cf30be217457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.953203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3c299-0651-4e2e-b66c-cf30be217457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.955899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3c299-0651-4e2e-b66c-cf30be217457 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.971892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 964/1915] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:05.976451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7bcca-16b3-48f0-a509-aaf0a5d04119 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.989518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7bcca-16b3-48f0-a509-aaf0a5d04119 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.995601 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b8e37-2cc1-43b8-90b1-4c3177befc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.996095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8e37-2cc1-43b8-90b1-4c3177befc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.996375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8e37-2cc1-43b8-90b1-4c3177befc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.996650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8e37-2cc1-43b8-90b1-4c3177befc65 admin admin] PATH_INFO: `/v3/projects/51be8dd5b20c4d86b86e56d374867040/users/d1d9b4b7032941b5829a41ab59fd4365/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.027379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3c299-0651-4e2e-b66c-cf30be217457 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.037529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b8e37-2cc1-43b8-90b1-4c3177befc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51be8dd5b20c4d86b86e56d374867040, user_id=d1d9b4b7032941b5829a41ab59fd4365, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.040062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b8e37-2cc1-43b8-90b1-4c3177befc65 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.050532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3c299-0651-4e2e-b66c-cf30be217457 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.055868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632b72b-7db1-4984-9b88-ce0ac251b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.056558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632b72b-7db1-4984-9b88-ce0ac251b675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.056845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632b72b-7db1-4984-9b88-ce0ac251b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.058261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632b72b-7db1-4984-9b88-ce0ac251b675 admin admin] PATH_INFO: `/v3/users/435207fce2bf42fbb5dce6998e2127c6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.071134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632b72b-7db1-4984-9b88-ce0ac251b675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435207fce2bf42fbb5dce6998e2127c6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.071134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632b72b-7db1-4984-9b88-ce0ac251b675 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.167504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 952/1916] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:05 2022] PUT /identity/v3/projects/51be8dd5b20c4d86b86e56d374867040/users/d1d9b4b7032941b5829a41ab59fd4365/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:06.171477 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b8e37-2cc1-43b8-90b1-4c3177befc65 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.236163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b8e37-2cc1-43b8-90b1-4c3177befc65 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.241128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1918d62-19de-4eac-9a56-1e723f56c4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.241746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1918d62-19de-4eac-9a56-1e723f56c4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.242028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1918d62-19de-4eac-9a56-1e723f56c4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.242301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1918d62-19de-4eac-9a56-1e723f56c4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.242956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1918d62-19de-4eac-9a56-1e723f56c4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.244595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1918d62-19de-4eac-9a56-1e723f56c4c8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.263496 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 953/1917] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:06.264820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1918d62-19de-4eac-9a56-1e723f56c4c8 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.275394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1918d62-19de-4eac-9a56-1e723f56c4c8 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.280291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d848b-fdf3-4a52-b56d-1556b56f8e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.280966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d848b-fdf3-4a52-b56d-1556b56f8e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.281250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d848b-fdf3-4a52-b56d-1556b56f8e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.281526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d848b-fdf3-4a52-b56d-1556b56f8e64 admin admin] PATH_INFO: `/v3/projects/51be8dd5b20c4d86b86e56d374867040/users/d1d9b4b7032941b5829a41ab59fd4365/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.283487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d848b-fdf3-4a52-b56d-1556b56f8e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51be8dd5b20c4d86b86e56d374867040, user_id=d1d9b4b7032941b5829a41ab59fd4365, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.287257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d848b-fdf3-4a52-b56d-1556b56f8e64 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.298471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 954/1918] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:06 2022] PUT /identity/v3/projects/51be8dd5b20c4d86b86e56d374867040/users/d1d9b4b7032941b5829a41ab59fd4365/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:06.309409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547e50-c5b6-44c2-ad43-4936aa3330be None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.309731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547e50-c5b6-44c2-ad43-4936aa3330be None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.310043 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547e50-c5b6-44c2-ad43-4936aa3330be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.325485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c632b72b-7db1-4984-9b88-ce0ac251b675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435207fce2bf42fbb5dce6998e2127c6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.326155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c632b72b-7db1-4984-9b88-ce0ac251b675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435207fce2bf42fbb5dce6998e2127c6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.326969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c632b72b-7db1-4984-9b88-ce0ac251b675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435207fce2bf42fbb5dce6998e2127c6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.340709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e6547e50-c5b6-44c2-ad43-4936aa3330be None None] MFA Rules not processed for user `d1d9b4b7032941b5829a41ab59fd4365`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:06.341938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e6547e50-c5b6-44c2-ad43-4936aa3330be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:06.417568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 955/1919] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:06 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:06.423413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c632b72b-7db1-4984-9b88-ce0ac251b675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435207fce2bf42fbb5dce6998e2127c6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.439248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6547e50-c5b6-44c2-ad43-4936aa3330be None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.444182 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e6547e50-c5b6-44c2-ad43-4936aa3330be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:06.447856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c632b72b-7db1-4984-9b88-ce0ac251b675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435207fce2bf42fbb5dce6998e2127c6'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.471968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 965/1920] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:06 2022] DELETE /identity/v3/users/435207fce2bf42fbb5dce6998e2127c6 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:06.476350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22201e3-ade2-4154-a774-d28037c3dee3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.476718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22201e3-ade2-4154-a774-d28037c3dee3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.477499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22201e3-ade2-4154-a774-d28037c3dee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.500730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d22201e3-ade2-4154-a774-d28037c3dee3 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:06.501961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d22201e3-ade2-4154-a774-d28037c3dee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:06.535501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6547e50-c5b6-44c2-ad43-4936aa3330be None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.565476 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 966/1921] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:06.576031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22201e3-ade2-4154-a774-d28037c3dee3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.578223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d22201e3-ade2-4154-a774-d28037c3dee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:06.589568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c54a4-2b23-481c-be55-bb2badd405bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.590235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c54a4-2b23-481c-be55-bb2badd405bd service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.590517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c54a4-2b23-481c-be55-bb2badd405bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.590800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c54a4-2b23-481c-be55-bb2badd405bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.640809 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22201e3-ade2-4154-a774-d28037c3dee3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.645268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657f6f8-e86e-4eff-9ef9-97a2af82311f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.646027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657f6f8-e86e-4eff-9ef9-97a2af82311f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.646386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657f6f8-e86e-4eff-9ef9-97a2af82311f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.646769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657f6f8-e86e-4eff-9ef9-97a2af82311f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.658481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657f6f8-e86e-4eff-9ef9-97a2af82311f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.660313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657f6f8-e86e-4eff-9ef9-97a2af82311f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.662630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c54a4-2b23-481c-be55-bb2badd405bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.664135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c54a4-2b23-481c-be55-bb2badd405bd service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.676139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 956/1922] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:06 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:06.676472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 967/1923] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:07.004288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c54a4-2b23-481c-be55-bb2badd405bd service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.013007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c54a4-2b23-481c-be55-bb2badd405bd service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.017072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069786-6dae-40ea-a74d-693bb7a42917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.017685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069786-6dae-40ea-a74d-693bb7a42917 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.017966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069786-6dae-40ea-a74d-693bb7a42917 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.018269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069786-6dae-40ea-a74d-693bb7a42917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.020645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-96069786-6dae-40ea-a74d-693bb7a42917 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:07.046903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:07.086562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96069786-6dae-40ea-a74d-693bb7a42917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.086562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96069786-6dae-40ea-a74d-693bb7a42917 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.094544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 957/1924] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:07.161544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657f6f8-e86e-4eff-9ef9-97a2af82311f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.164007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b657f6f8-e86e-4eff-9ef9-97a2af82311f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:07.189072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657f6f8-e86e-4eff-9ef9-97a2af82311f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.202876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.203578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.203866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.204244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] PATH_INFO: `/v3/projects/8d995605b5b248188b22e00607a379d3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.206783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d995605b5b248188b22e00607a379d3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.210256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.349921 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d995605b5b248188b22e00607a379d3', 'request_id': 'req-026c151c-eebc-44e2-93ba-3501ad78bf3c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.423690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d995605b5b248188b22e00607a379d3', 'request_id': 'req-026c151c-eebc-44e2-93ba-3501ad78bf3c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.430247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d995605b5b248188b22e00607a379d3', 'request_id': 'req-026c151c-eebc-44e2-93ba-3501ad78bf3c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.445012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] The token cache is being invalidate because project 8d995605b5b248188b22e00607a379d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:07.445423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.446047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.447889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 968/1925] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:07 2022] DELETE /identity/v3/projects/8d995605b5b248188b22e00607a379d3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:07.451756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069786-6dae-40ea-a74d-693bb7a42917 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.464005 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069786-6dae-40ea-a74d-693bb7a42917 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.523501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae109e6-181b-434f-ae27-d7a1c4b4930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.524763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae109e6-181b-434f-ae27-d7a1c4b4930b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.525080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae109e6-181b-434f-ae27-d7a1c4b4930b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.525360 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae109e6-181b-434f-ae27-d7a1c4b4930b admin admin] PATH_INFO: `/v3/users/2158f4bcb2434b19bf68f860fe0bec8f` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.526556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae109e6-181b-434f-ae27-d7a1c4b4930b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2158f4bcb2434b19bf68f860fe0bec8f)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.528662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae109e6-181b-434f-ae27-d7a1c4b4930b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.809654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ae109e6-181b-434f-ae27-d7a1c4b4930b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2158f4bcb2434b19bf68f860fe0bec8f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.881380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ae109e6-181b-434f-ae27-d7a1c4b4930b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2158f4bcb2434b19bf68f860fe0bec8f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.893569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ae109e6-181b-434f-ae27-d7a1c4b4930b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2158f4bcb2434b19bf68f860fe0bec8f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.895452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ae109e6-181b-434f-ae27-d7a1c4b4930b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2158f4bcb2434b19bf68f860fe0bec8f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.908014 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7ae109e6-181b-434f-ae27-d7a1c4b4930b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2158f4bcb2434b19bf68f860fe0bec8f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.914806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 958/1926] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:07 2022] DELETE /identity/v3/users/2158f4bcb2434b19bf68f860fe0bec8f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:08.153971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:08.363830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:08.447578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:08.447578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:08.458649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c151c-eebc-44e2-93ba-3501ad78bf3c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:08.528312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:08.528957 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.529244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.529523 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] PATH_INFO: `/v3/projects/c4bcd5c03f92415bb971a863182ced12` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.530758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bcd5c03f92415bb971a863182ced12)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:08.532707 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:08.640457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bcd5c03f92415bb971a863182ced12', 'request_id': 'req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:08.726309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bcd5c03f92415bb971a863182ced12', 'request_id': 'req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:08.734807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bcd5c03f92415bb971a863182ced12', 'request_id': 'req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:08.751287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] The token cache is being invalidate because project c4bcd5c03f92415bb971a863182ced12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:08.752641 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:08.755551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5c87e1ce-82e8-4beb-b4de-c6b29fa8c06d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:08.761100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 969/1927] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:08 2022] DELETE /identity/v3/projects/c4bcd5c03f92415bb971a863182ced12 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:08.768871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b72806-c0aa-4e55-8619-ff76de184d30 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.769153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b72806-c0aa-4e55-8619-ff76de184d30 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.769613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b72806-c0aa-4e55-8619-ff76de184d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.793626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c8b72806-c0aa-4e55-8619-ff76de184d30 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:08.795316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c8b72806-c0aa-4e55-8619-ff76de184d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:08.863488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 959/1928] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:08.871462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8c9a-9b21-484b-873b-b9cfbce4f17b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.871798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8c9a-9b21-484b-873b-b9cfbce4f17b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.872091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8c9a-9b21-484b-873b-b9cfbce4f17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.891332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a1ef8c9a-9b21-484b-873b-b9cfbce4f17b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:08.892559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a1ef8c9a-9b21-484b-873b-b9cfbce4f17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:08.901664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 970/1929] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:08.906036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b72806-c0aa-4e55-8619-ff76de184d30 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:08.917027 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b72806-c0aa-4e55-8619-ff76de184d30 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:08.921886 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842d88e-1e77-4606-ac9f-6f0d2b0d768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:08.922522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d88e-1e77-4606-ac9f-6f0d2b0d768a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.922808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d88e-1e77-4606-ac9f-6f0d2b0d768a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.923125 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d88e-1e77-4606-ac9f-6f0d2b0d768a admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.923830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842d88e-1e77-4606-ac9f-6f0d2b0d768a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:08.924137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842d88e-1e77-4606-ac9f-6f0d2b0d768a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:08.926043 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842d88e-1e77-4606-ac9f-6f0d2b0d768a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:08.938047 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 960/1930] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:49:08.942449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef8c9a-9b21-484b-873b-b9cfbce4f17b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:08.951929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef8c9a-9b21-484b-873b-b9cfbce4f17b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:08.957134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56dc23-5e1a-4ddf-a83c-9d90a02fbb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:08.958064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56dc23-5e1a-4ddf-a83c-9d90a02fbb7b admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.958325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56dc23-5e1a-4ddf-a83c-9d90a02fbb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.958603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56dc23-5e1a-4ddf-a83c-9d90a02fbb7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.959279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56dc23-5e1a-4ddf-a83c-9d90a02fbb7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:08.961222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56dc23-5e1a-4ddf-a83c-9d90a02fbb7b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:08.964940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:09.084538 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 971/1931] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:08 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:09.089159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842d88e-1e77-4606-ac9f-6f0d2b0d768a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:09.101633 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842d88e-1e77-4606-ac9f-6f0d2b0d768a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:09.162228 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf79fe-9ed3-4287-ad04-f9976fd95035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:09.162904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf79fe-9ed3-4287-ad04-f9976fd95035 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:09.163220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf79fe-9ed3-4287-ad04-f9976fd95035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:09.163552 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf79fe-9ed3-4287-ad04-f9976fd95035 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:09.164190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf79fe-9ed3-4287-ad04-f9976fd95035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:09.166233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf79fe-9ed3-4287-ad04-f9976fd95035 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:09.263903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 961/1932] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:09 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:09.268055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56dc23-5e1a-4ddf-a83c-9d90a02fbb7b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:09.279755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56dc23-5e1a-4ddf-a83c-9d90a02fbb7b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:09.284508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11e6f0-ed8d-40d7-8c61-2b1469b0ec1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:09.285121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11e6f0-ed8d-40d7-8c61-2b1469b0ec1f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:09.285403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11e6f0-ed8d-40d7-8c61-2b1469b0ec1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:09.285678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11e6f0-ed8d-40d7-8c61-2b1469b0ec1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:09.286387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11e6f0-ed8d-40d7-8c61-2b1469b0ec1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:09.288038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11e6f0-ed8d-40d7-8c61-2b1469b0ec1f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:09.298110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 972/1933] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:09.302391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf79fe-9ed3-4287-ad04-f9976fd95035 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:09.312627 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf79fe-9ed3-4287-ad04-f9976fd95035 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:09.317950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9713d-d121-465d-8423-b145d92b3329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:09.318560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9713d-d121-465d-8423-b145d92b3329 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:09.318891 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9713d-d121-465d-8423-b145d92b3329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:09.319206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9713d-d121-465d-8423-b145d92b3329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:09.319857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9713d-d121-465d-8423-b145d92b3329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:09.321468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9713d-d121-465d-8423-b145d92b3329 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:09.333246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 962/1934] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:09.337638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11e6f0-ed8d-40d7-8c61-2b1469b0ec1f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:09.347986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11e6f0-ed8d-40d7-8c61-2b1469b0ec1f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:09.352810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc56b88-cedc-4f4b-a64f-d47018dc55b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:09.353479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56b88-cedc-4f4b-a64f-d47018dc55b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:09.353767 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56b88-cedc-4f4b-a64f-d47018dc55b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:09.354048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56b88-cedc-4f4b-a64f-d47018dc55b7 admin admin] PATH_INFO: `/v3/projects/1c34c3101a984ca6ab4d21b19e44f98e/users/bbf88046804b428483e7d96ceb6d8bea/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:09.373115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc56b88-cedc-4f4b-a64f-d47018dc55b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c34c3101a984ca6ab4d21b19e44f98e, user_id=bbf88046804b428483e7d96ceb6d8bea, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:09.376690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc56b88-cedc-4f4b-a64f-d47018dc55b7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:09.463542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 973/1935] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:09 2022] PUT /identity/v3/projects/1c34c3101a984ca6ab4d21b19e44f98e/users/bbf88046804b428483e7d96ceb6d8bea/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:09.474200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655ecd-41c3-4b0c-8626-de7a818b6de3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:09.474491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655ecd-41c3-4b0c-8626-de7a818b6de3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:09.474771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655ecd-41c3-4b0c-8626-de7a818b6de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:09.502758 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-07655ecd-41c3-4b0c-8626-de7a818b6de3 None None] MFA Rules not processed for user `bbf88046804b428483e7d96ceb6d8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:09.504562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-07655ecd-41c3-4b0c-8626-de7a818b6de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:09.572894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 963/1936] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:09.584806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc56b88-cedc-4f4b-a64f-d47018dc55b7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:09.586788 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5dc56b88-cedc-4f4b-a64f-d47018dc55b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:09.648082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc56b88-cedc-4f4b-a64f-d47018dc55b7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:09.651879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd2e8d-6558-4f4f-ac9b-e78a6be79d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:09.652507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2e8d-6558-4f4f-ac9b-e78a6be79d2e service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:09.652792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2e8d-6558-4f4f-ac9b-e78a6be79d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:09.653071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2e8d-6558-4f4f-ac9b-e78a6be79d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:09.661946 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd2e8d-6558-4f4f-ac9b-e78a6be79d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:09.663955 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd2e8d-6558-4f4f-ac9b-e78a6be79d2e service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:09.672514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 974/1937] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:09.692501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07655ecd-41c3-4b0c-8626-de7a818b6de3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:09.769907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07655ecd-41c3-4b0c-8626-de7a818b6de3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:09.781701 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:09.782367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:09.782648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:09.787694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] PATH_INFO: `/v3/users/bbf88046804b428483e7d96ceb6d8bea` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:09.790461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf88046804b428483e7d96ceb6d8bea)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:09.791288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:10.080298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf88046804b428483e7d96ceb6d8bea'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.190406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:10.191380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf88046804b428483e7d96ceb6d8bea'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.209919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf88046804b428483e7d96ceb6d8bea'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.211214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf88046804b428483e7d96ceb6d8bea'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.243893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf88046804b428483e7d96ceb6d8bea'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.247974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 964/1938] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:09 2022] DELETE /identity/v3/users/bbf88046804b428483e7d96ceb6d8bea => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:10.249692 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5246dfc-9640-463c-aa48-2fae6a7a5d93 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.249980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5246dfc-9640-463c-aa48-2fae6a7a5d93 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.250253 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5246dfc-9640-463c-aa48-2fae6a7a5d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.271855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b5246dfc-9640-463c-aa48-2fae6a7a5d93 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:10.273152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b5246dfc-9640-463c-aa48-2fae6a7a5d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:10.345075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 975/1939] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:10.355682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:10.357174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:10.417566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bf2ea-1d88-4da9-a816-c18190ee8d1d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:10.421228 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ffe6e-d204-4636-a22d-eced2ac939e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:10.422303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ffe6e-d204-4636-a22d-eced2ac939e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.422303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ffe6e-d204-4636-a22d-eced2ac939e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.422501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ffe6e-d204-4636-a22d-eced2ac939e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.433996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ffe6e-d204-4636-a22d-eced2ac939e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:10.439196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ffe6e-d204-4636-a22d-eced2ac939e8 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:10.446984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 965/1940] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:10.539977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5246dfc-9640-463c-aa48-2fae6a7a5d93 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:10.542158 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b5246dfc-9640-463c-aa48-2fae6a7a5d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:10.558807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5246dfc-9640-463c-aa48-2fae6a7a5d93 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:10.564774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:10.565660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.566534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.567199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] PATH_INFO: `/v3/users/9f9efe304bbf484f8d1bbeebe2b6e469` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.568500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f9efe304bbf484f8d1bbeebe2b6e469)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:10.571363 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:10.978388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9efe304bbf484f8d1bbeebe2b6e469'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.979369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9efe304bbf484f8d1bbeebe2b6e469'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.980145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9efe304bbf484f8d1bbeebe2b6e469'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:11.086458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:11.112471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9efe304bbf484f8d1bbeebe2b6e469'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:11.130805 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9efe304bbf484f8d1bbeebe2b6e469'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:11.149175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 976/1941] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:10 2022] DELETE /identity/v3/users/9f9efe304bbf484f8d1bbeebe2b6e469 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:11.156378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2df55d-d571-4480-a13d-7d02101a0208 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:11.159095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2df55d-d571-4480-a13d-7d02101a0208 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:11.159095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2df55d-d571-4480-a13d-7d02101a0208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:11.186043 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8c2df55d-d571-4480-a13d-7d02101a0208 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:11.188381 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8c2df55d-d571-4480-a13d-7d02101a0208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:11.277918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 966/1942] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:11.332880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:11.334428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:11.421096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027ebe9-46ae-426a-ab0e-40d2aa2ed33f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:11.424918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4174345-1400-4f53-88d6-7e25a7d234c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:11.426132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174345-1400-4f53-88d6-7e25a7d234c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:11.427090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174345-1400-4f53-88d6-7e25a7d234c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:11.427375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174345-1400-4f53-88d6-7e25a7d234c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:11.437422 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4174345-1400-4f53-88d6-7e25a7d234c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:11.439013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4174345-1400-4f53-88d6-7e25a7d234c9 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:11.451987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 977/1943] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:11.528063 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2df55d-d571-4480-a13d-7d02101a0208 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:11.529845 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8c2df55d-d571-4480-a13d-7d02101a0208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:11.545542 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2df55d-d571-4480-a13d-7d02101a0208 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:11.556751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:11.558030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:11.558458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:11.559548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] PATH_INFO: `/v3/projects/1c34c3101a984ca6ab4d21b19e44f98e` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:11.561460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c34c3101a984ca6ab4d21b19e44f98e)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:11.585170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:11.830952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c34c3101a984ca6ab4d21b19e44f98e', 'request_id': 'req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:11.837615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c34c3101a984ca6ab4d21b19e44f98e', 'request_id': 'req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:11.993566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c34c3101a984ca6ab4d21b19e44f98e', 'request_id': 'req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:12.014062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] The token cache is being invalidate because project 1c34c3101a984ca6ab4d21b19e44f98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:12.014465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:12.015322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-67a3cc9d-6dfe-419b-bffb-4f9da5ca4b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:12.017363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 967/1944] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:11 2022] DELETE /identity/v3/projects/1c34c3101a984ca6ab4d21b19e44f98e => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:12.022485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c420c0-c8d2-4c5e-bbda-d7a49d89ecf2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.023004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c420c0-c8d2-4c5e-bbda-d7a49d89ecf2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.023147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c420c0-c8d2-4c5e-bbda-d7a49d89ecf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.097476 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d4c420c0-c8d2-4c5e-bbda-d7a49d89ecf2 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:12.098769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d4c420c0-c8d2-4c5e-bbda-d7a49d89ecf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:12.200926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:12.209051 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 978/1945] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:12.217462 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186b054-3a51-4470-ba68-93a3dd3f2089 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.218058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186b054-3a51-4470-ba68-93a3dd3f2089 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.218511 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186b054-3a51-4470-ba68-93a3dd3f2089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.242164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c186b054-3a51-4470-ba68-93a3dd3f2089 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:12.243876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c186b054-3a51-4470-ba68-93a3dd3f2089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:12.256965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 968/1946] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:12.257599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c420c0-c8d2-4c5e-bbda-d7a49d89ecf2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.269561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c420c0-c8d2-4c5e-bbda-d7a49d89ecf2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.274851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f9206-c5c1-415d-973f-70ea88c64e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.275550 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f9206-c5c1-415d-973f-70ea88c64e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.276026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f9206-c5c1-415d-973f-70ea88c64e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.276311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f9206-c5c1-415d-973f-70ea88c64e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.277024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f9206-c5c1-415d-973f-70ea88c64e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:12.277337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f9206-c5c1-415d-973f-70ea88c64e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.278963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f9206-c5c1-415d-973f-70ea88c64e7c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.297174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 979/1947] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:49:12.301861 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186b054-3a51-4470-ba68-93a3dd3f2089 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.312774 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186b054-3a51-4470-ba68-93a3dd3f2089 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.329638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a43d2-e7ae-4ba9-a02f-0d606ce31d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.329638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a43d2-e7ae-4ba9-a02f-0d606ce31d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.329638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a43d2-e7ae-4ba9-a02f-0d606ce31d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.329638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a43d2-e7ae-4ba9-a02f-0d606ce31d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.330019 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a43d2-e7ae-4ba9-a02f-0d606ce31d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.332774 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a43d2-e7ae-4ba9-a02f-0d606ce31d0d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.456138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 969/1948] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:12 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:12.460474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f9206-c5c1-415d-973f-70ea88c64e7c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.481865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f9206-c5c1-415d-973f-70ea88c64e7c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.640615 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31467bc6-be37-459d-a2f3-b5299f17e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.642286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31467bc6-be37-459d-a2f3-b5299f17e538 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.642577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31467bc6-be37-459d-a2f3-b5299f17e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.642857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31467bc6-be37-459d-a2f3-b5299f17e538 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.646658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31467bc6-be37-459d-a2f3-b5299f17e538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.657756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31467bc6-be37-459d-a2f3-b5299f17e538 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.855087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 980/1949] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:12 2022] POST /identity/v3/users => generated 287 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:12.859256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a43d2-e7ae-4ba9-a02f-0d606ce31d0d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.873009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a43d2-e7ae-4ba9-a02f-0d606ce31d0d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.880986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a67eb-b622-4276-a1dd-9b5a6b137312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.881917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a67eb-b622-4276-a1dd-9b5a6b137312 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.882257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a67eb-b622-4276-a1dd-9b5a6b137312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.882541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a67eb-b622-4276-a1dd-9b5a6b137312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.883259 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a67eb-b622-4276-a1dd-9b5a6b137312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.885347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a67eb-b622-4276-a1dd-9b5a6b137312 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.902037 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 970/1950] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:12.907556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31467bc6-be37-459d-a2f3-b5299f17e538 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.911141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a67eb-b622-4276-a1dd-9b5a6b137312 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.914867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31467bc6-be37-459d-a2f3-b5299f17e538 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.915762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f65a67eb-b622-4276-a1dd-9b5a6b137312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:12.936087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e09db-b4e0-46c3-ae64-7911693293b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.937886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e09db-b4e0-46c3-ae64-7911693293b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.938840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a67eb-b622-4276-a1dd-9b5a6b137312 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.945673 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.946002 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e09db-b4e0-46c3-ae64-7911693293b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.946361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.946648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.947957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] PATH_INFO: `/v3/projects/f04cdfbb7f7a49e596da4797c7a18739` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.948942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e09db-b4e0-46c3-ae64-7911693293b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.950162 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e09db-b4e0-46c3-ae64-7911693293b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.950742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04cdfbb7f7a49e596da4797c7a18739)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.951892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e09db-b4e0-46c3-ae64-7911693293b7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.953602 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.972649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 981/1951] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:12.974998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e09db-b4e0-46c3-ae64-7911693293b7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.986998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e09db-b4e0-46c3-ae64-7911693293b7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.998205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def53e36-7dec-47f7-beaf-96651712d316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.998903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def53e36-7dec-47f7-beaf-96651712d316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.999235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def53e36-7dec-47f7-beaf-96651712d316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.999517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def53e36-7dec-47f7-beaf-96651712d316 admin admin] PATH_INFO: `/v3/projects/a40b38a0b6254bacafd3f8c898b15688/users/57673e9e7781435d971aca84980e2601/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:13.021247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def53e36-7dec-47f7-beaf-96651712d316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40b38a0b6254bacafd3f8c898b15688, user_id=57673e9e7781435d971aca84980e2601, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:13.024242 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def53e36-7dec-47f7-beaf-96651712d316 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:13.108587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 982/1952] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:12 2022] PUT /identity/v3/projects/a40b38a0b6254bacafd3f8c898b15688/users/57673e9e7781435d971aca84980e2601/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:13.110235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66436e5-689d-4442-ab73-10e28508a540 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:13.110598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66436e5-689d-4442-ab73-10e28508a540 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:13.116242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04cdfbb7f7a49e596da4797c7a18739', 'request_id': 'req-c5a0c976-667e-4f6c-86ef-d7360020016c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.118602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66436e5-689d-4442-ab73-10e28508a540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:13.142253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04cdfbb7f7a49e596da4797c7a18739', 'request_id': 'req-c5a0c976-667e-4f6c-86ef-d7360020016c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.170974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b66436e5-689d-4442-ab73-10e28508a540 None None] MFA Rules not processed for user `57673e9e7781435d971aca84980e2601`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:13.172658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b66436e5-689d-4442-ab73-10e28508a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:13.242208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04cdfbb7f7a49e596da4797c7a18739', 'request_id': 'req-c5a0c976-667e-4f6c-86ef-d7360020016c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.248040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 983/1953] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:13.252668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66436e5-689d-4442-ab73-10e28508a540 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:13.256527 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] The token cache is being invalidate because project f04cdfbb7f7a49e596da4797c7a18739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:13.256829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.257508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.259363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 971/1954] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:12 2022] DELETE /identity/v3/projects/f04cdfbb7f7a49e596da4797c7a18739 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:13.263956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:13.265375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:13.374924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66436e5-689d-4442-ab73-10e28508a540 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:13.383287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0c976-667e-4f6c-86ef-d7360020016c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:13.383516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47218856-6144-4937-8c9b-a9237d758c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:13.384047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218856-6144-4937-8c9b-a9237d758c70 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:13.384328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218856-6144-4937-8c9b-a9237d758c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:13.384613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218856-6144-4937-8c9b-a9237d758c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:13.385706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47218856-6144-4937-8c9b-a9237d758c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:13.387746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47218856-6144-4937-8c9b-a9237d758c70 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:13.390309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:13.391200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:13.391650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:13.392174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] PATH_INFO: `/v3/users/52f9a274830f4c6d965139f4af1632de` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:13.393572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f9a274830f4c6d965139f4af1632de)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:13.396548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:13.561902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 984/1955] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:13 2022] POST /identity/v3/projects => generated 375 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:13.566211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47218856-6144-4937-8c9b-a9237d758c70 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:13.568071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-47218856-6144-4937-8c9b-a9237d758c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:13.585675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:13.640353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47218856-6144-4937-8c9b-a9237d758c70 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:13.646059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5de2b-c263-415e-b9cb-8e2cf21fbc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:13.656925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5de2b-c263-415e-b9cb-8e2cf21fbc8a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:13.656925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5de2b-c263-415e-b9cb-8e2cf21fbc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:13.656925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5de2b-c263-415e-b9cb-8e2cf21fbc8a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:13.656925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5de2b-c263-415e-b9cb-8e2cf21fbc8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:13.656925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5de2b-c263-415e-b9cb-8e2cf21fbc8a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:13.657465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f9a274830f4c6d965139f4af1632de'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.758809 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f9a274830f4c6d965139f4af1632de'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.775377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f9a274830f4c6d965139f4af1632de'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.775377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f9a274830f4c6d965139f4af1632de'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.800401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f9a274830f4c6d965139f4af1632de'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.806197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 985/1956] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:13 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:13.807798 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 972/1957] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:13 2022] DELETE /identity/v3/users/52f9a274830f4c6d965139f4af1632de => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:13.814345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5de2b-c263-415e-b9cb-8e2cf21fbc8a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:13.814345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-88e5de2b-c263-415e-b9cb-8e2cf21fbc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:13.827320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5de2b-c263-415e-b9cb-8e2cf21fbc8a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:13.901933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee72fd5-c68f-4db3-bd93-5486a0a66b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:13.902709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee72fd5-c68f-4db3-bd93-5486a0a66b9c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:13.903006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee72fd5-c68f-4db3-bd93-5486a0a66b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:13.910375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee72fd5-c68f-4db3-bd93-5486a0a66b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:13.910375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee72fd5-c68f-4db3-bd93-5486a0a66b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:13.910375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee72fd5-c68f-4db3-bd93-5486a0a66b9c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:13.922752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 986/1958] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:13.927569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:13.943518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52809e5d-b9d5-43ac-a12f-44fc978b547a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:13.951724 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91343-fc7b-4df5-96a5-ecb368e28f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:13.952878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91343-fc7b-4df5-96a5-ecb368e28f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:13.953458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91343-fc7b-4df5-96a5-ecb368e28f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:13.953961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91343-fc7b-4df5-96a5-ecb368e28f0a admin admin] PATH_INFO: `/v3/projects/baa43cb016734a188cf5fbc859a477d9/users/0dbc6b9287994479b469a686a28e64b2/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:13.992387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d91343-fc7b-4df5-96a5-ecb368e28f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa43cb016734a188cf5fbc859a477d9, user_id=0dbc6b9287994479b469a686a28e64b2, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:13.995711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d91343-fc7b-4df5-96a5-ecb368e28f0a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:14.069752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee72fd5-c68f-4db3-bd93-5486a0a66b9c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:14.072133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4ee72fd5-c68f-4db3-bd93-5486a0a66b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:14.092761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee72fd5-c68f-4db3-bd93-5486a0a66b9c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:14.096121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 973/1959] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:13 2022] PUT /identity/v3/projects/baa43cb016734a188cf5fbc859a477d9/users/0dbc6b9287994479b469a686a28e64b2/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:14.097277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91343-fc7b-4df5-96a5-ecb368e28f0a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:14.181024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:14.181800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:14.182311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:14.182685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] PATH_INFO: `/v3/users/c0378bcedba543adb4c40968a961a458` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:14.184370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0378bcedba543adb4c40968a961a458)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:14.186455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:14.291950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91343-fc7b-4df5-96a5-ecb368e28f0a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:14.297126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570c081-fd98-41d9-843f-bb06b2cbca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:14.297764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570c081-fd98-41d9-843f-bb06b2cbca34 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:14.298052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570c081-fd98-41d9-843f-bb06b2cbca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:14.298335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570c081-fd98-41d9-843f-bb06b2cbca34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:14.306051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570c081-fd98-41d9-843f-bb06b2cbca34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:14.307985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570c081-fd98-41d9-843f-bb06b2cbca34 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:14.324751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 974/1960] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:14.329747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570c081-fd98-41d9-843f-bb06b2cbca34 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:14.341706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570c081-fd98-41d9-843f-bb06b2cbca34 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:14.348883 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9cef2-78ff-4b4e-b21b-7294255eaf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:14.349580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9cef2-78ff-4b4e-b21b-7294255eaf93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:14.349875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9cef2-78ff-4b4e-b21b-7294255eaf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:14.350153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9cef2-78ff-4b4e-b21b-7294255eaf93 admin admin] PATH_INFO: `/v3/projects/baa43cb016734a188cf5fbc859a477d9/users/0dbc6b9287994479b469a686a28e64b2/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:14.352603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9cef2-78ff-4b4e-b21b-7294255eaf93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa43cb016734a188cf5fbc859a477d9, user_id=0dbc6b9287994479b469a686a28e64b2, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:14.355341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9cef2-78ff-4b4e-b21b-7294255eaf93 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:14.375897 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 975/1961] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:14 2022] PUT /identity/v3/projects/baa43cb016734a188cf5fbc859a477d9/users/0dbc6b9287994479b469a686a28e64b2/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:14.386864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485d45-be55-4dce-9125-5ca663145da9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:14.387577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485d45-be55-4dce-9125-5ca663145da9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:14.388023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3485d45-be55-4dce-9125-5ca663145da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:14.439177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f3485d45-be55-4dce-9125-5ca663145da9 None None] MFA Rules not processed for user `0dbc6b9287994479b469a686a28e64b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:14.440946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f3485d45-be55-4dce-9125-5ca663145da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:14.520722 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0378bcedba543adb4c40968a961a458'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.521892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0378bcedba543adb4c40968a961a458'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.522898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0378bcedba543adb4c40968a961a458'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.552454 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 976/1962] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:14.564304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3485d45-be55-4dce-9125-5ca663145da9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:14.566579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f3485d45-be55-4dce-9125-5ca663145da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:14.643529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3485d45-be55-4dce-9125-5ca663145da9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:14.648792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:14.649442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:14.649824 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:14.650711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] PATH_INFO: `/v3/projects/b2e7ad298c7e47269ce1439ffb3af49b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:14.651800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0378bcedba543adb4c40968a961a458'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.651983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2e7ad298c7e47269ce1439ffb3af49b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:14.653949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:14.673096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0378bcedba543adb4c40968a961a458'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.694040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 987/1963] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:14 2022] DELETE /identity/v3/users/c0378bcedba543adb4c40968a961a458 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:14.694907 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:14.696288 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:14.770480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c88d2f-67a0-4469-b8a2-fbb879ab3725 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:14.774243 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b01207-5bfe-4677-a56c-9edfe1c94027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:14.774860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b01207-5bfe-4677-a56c-9edfe1c94027 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:14.775182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b01207-5bfe-4677-a56c-9edfe1c94027 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:14.775470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b01207-5bfe-4677-a56c-9edfe1c94027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:14.777263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-13b01207-5bfe-4677-a56c-9edfe1c94027 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:14.837155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e7ad298c7e47269ce1439ffb3af49b', 'request_id': 'req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.845821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e7ad298c7e47269ce1439ffb3af49b', 'request_id': 'req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.858834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b01207-5bfe-4677-a56c-9edfe1c94027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:14.860564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b01207-5bfe-4677-a56c-9edfe1c94027 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:14.870399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 988/1964] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:14.871580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac71657-468d-42cc-86aa-43418a5a2b29 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:14.871874 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac71657-468d-42cc-86aa-43418a5a2b29 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:14.872245 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac71657-468d-42cc-86aa-43418a5a2b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:14.898625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-eac71657-468d-42cc-86aa-43418a5a2b29 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:14.899893 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eac71657-468d-42cc-86aa-43418a5a2b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:14.977954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e7ad298c7e47269ce1439ffb3af49b', 'request_id': 'req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.998657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] The token cache is being invalidate because project b2e7ad298c7e47269ce1439ffb3af49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:14.998657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.998657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6b224f40-8a30-4cb4-8a70-a5260cbdcbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.998657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 977/1965] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:14 2022] DELETE /identity/v3/projects/b2e7ad298c7e47269ce1439ffb3af49b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:14.999342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 989/1966] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:15.002971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8c539-d4a5-4bb1-843d-13395c35f3c6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.003550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8c539-d4a5-4bb1-843d-13395c35f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.004285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8c539-d4a5-4bb1-843d-13395c35f3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.006356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac71657-468d-42cc-86aa-43418a5a2b29 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:15.008171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eac71657-468d-42cc-86aa-43418a5a2b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:15.038882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-68c8c539-d4a5-4bb1-843d-13395c35f3c6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:15.040964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-68c8c539-d4a5-4bb1-843d-13395c35f3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:15.059493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 978/1967] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:15.072358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bdd25-577e-43c8-a924-6dfc9a41072a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.072358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bdd25-577e-43c8-a924-6dfc9a41072a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.072358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bdd25-577e-43c8-a924-6dfc9a41072a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.099918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac71657-468d-42cc-86aa-43418a5a2b29 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:15.104435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53ae71-43c7-4055-9eab-166ab7a821ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:15.105082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53ae71-43c7-4055-9eab-166ab7a821ac service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.105516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53ae71-43c7-4055-9eab-166ab7a821ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.105675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53ae71-43c7-4055-9eab-166ab7a821ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.106869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ac8bdd25-577e-43c8-a924-6dfc9a41072a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:15.108210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-df53ae71-43c7-4055-9eab-166ab7a821ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:15.108831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ac8bdd25-577e-43c8-a924-6dfc9a41072a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:15.123378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 979/1968] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:15.127621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bdd25-577e-43c8-a924-6dfc9a41072a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:15.139293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53ae71-43c7-4055-9eab-166ab7a821ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:15.142815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53ae71-43c7-4055-9eab-166ab7a821ac service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:15.145540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bdd25-577e-43c8-a924-6dfc9a41072a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:15.152179 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34555-5a77-4219-b2cf-81560fac3af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:15.153284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34555-5a77-4219-b2cf-81560fac3af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.153744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34555-5a77-4219-b2cf-81560fac3af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.154205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34555-5a77-4219-b2cf-81560fac3af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.155337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34555-5a77-4219-b2cf-81560fac3af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:15.158737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34555-5a77-4219-b2cf-81560fac3af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:15.158737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34555-5a77-4219-b2cf-81560fac3af6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:15.161065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 990/1969] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:15.171765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 980/1970] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:15.176931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53ae71-43c7-4055-9eab-166ab7a821ac service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:15.188746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53ae71-43c7-4055-9eab-166ab7a821ac service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:15.194519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e32af1-dcb0-43c0-8614-9e1ed07d473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:15.195201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e32af1-dcb0-43c0-8614-9e1ed07d473f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.195483 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e32af1-dcb0-43c0-8614-9e1ed07d473f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.195755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e32af1-dcb0-43c0-8614-9e1ed07d473f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.196445 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e32af1-dcb0-43c0-8614-9e1ed07d473f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:15.198376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e32af1-dcb0-43c0-8614-9e1ed07d473f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:15.319872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 991/1971] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:15 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:15.321114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34555-5a77-4219-b2cf-81560fac3af6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:15.333695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34555-5a77-4219-b2cf-81560fac3af6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:15.372045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:15.405005 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da418d-4389-4edf-adb5-bdac074fa2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:15.406284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da418d-4389-4edf-adb5-bdac074fa2ac admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.406596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da418d-4389-4edf-adb5-bdac074fa2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.407019 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da418d-4389-4edf-adb5-bdac074fa2ac admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.424011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da418d-4389-4edf-adb5-bdac074fa2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:15.424011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da418d-4389-4edf-adb5-bdac074fa2ac admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:15.530264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 981/1972] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:15 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:15.537605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e32af1-dcb0-43c0-8614-9e1ed07d473f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:15.548213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e32af1-dcb0-43c0-8614-9e1ed07d473f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:15.553937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd3bf-1ba8-4910-9167-f864e0539f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:15.554557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd3bf-1ba8-4910-9167-f864e0539f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.554886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd3bf-1ba8-4910-9167-f864e0539f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.555474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd3bf-1ba8-4910-9167-f864e0539f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.556165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fd3bf-1ba8-4910-9167-f864e0539f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:15.558289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fd3bf-1ba8-4910-9167-f864e0539f49 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:15.580479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 992/1973] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:15.585045 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da418d-4389-4edf-adb5-bdac074fa2ac admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:15.600981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da418d-4389-4edf-adb5-bdac074fa2ac admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:15.607126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60722f-4a8c-450e-99b0-7bfe022cb137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:15.608008 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60722f-4a8c-450e-99b0-7bfe022cb137 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.608360 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60722f-4a8c-450e-99b0-7bfe022cb137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.608715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60722f-4a8c-450e-99b0-7bfe022cb137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.609535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60722f-4a8c-450e-99b0-7bfe022cb137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:15.611437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60722f-4a8c-450e-99b0-7bfe022cb137 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:15.625078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 982/1974] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:15.629238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd3bf-1ba8-4910-9167-f864e0539f49 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:15.640665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd3bf-1ba8-4910-9167-f864e0539f49 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:15.647178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c64c4-d2fe-4e5b-9f17-e0312e4b9a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:15.648166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c64c4-d2fe-4e5b-9f17-e0312e4b9a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.648517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c64c4-d2fe-4e5b-9f17-e0312e4b9a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.648899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c64c4-d2fe-4e5b-9f17-e0312e4b9a48 admin admin] PATH_INFO: `/v3/projects/74c2f60f6c824f71a9d7be39f11b48aa/users/15372b0ce2fc44a5b70634ca846a843d/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.666436 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c64c4-d2fe-4e5b-9f17-e0312e4b9a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c2f60f6c824f71a9d7be39f11b48aa, user_id=15372b0ce2fc44a5b70634ca846a843d, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:15.669624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c64c4-d2fe-4e5b-9f17-e0312e4b9a48 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:15.829002 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:15.840889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60722f-4a8c-450e-99b0-7bfe022cb137 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:15.844107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7b60722f-4a8c-450e-99b0-7bfe022cb137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:15.855488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 993/1975] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:15 2022] PUT /identity/v3/projects/74c2f60f6c824f71a9d7be39f11b48aa/users/15372b0ce2fc44a5b70634ca846a843d/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:15.861263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60722f-4a8c-450e-99b0-7bfe022cb137 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:15.873170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2660b5b-280c-46ed-98ed-c89925572702 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.873865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2660b5b-280c-46ed-98ed-c89925572702 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.874448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2660b5b-280c-46ed-98ed-c89925572702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.926955 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d2660b5b-280c-46ed-98ed-c89925572702 None None] MFA Rules not processed for user `15372b0ce2fc44a5b70634ca846a843d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:15.928743 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d2660b5b-280c-46ed-98ed-c89925572702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:15.957403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:15.958323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.958607 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.958882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] PATH_INFO: `/v3/projects/6dced82cdd834cc0a6869f506b409184` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.960826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dced82cdd834cc0a6869f506b409184)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:15.966178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.013748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 994/1976] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:16.018299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2660b5b-280c-46ed-98ed-c89925572702 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.029004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2660b5b-280c-46ed-98ed-c89925572702 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.033723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1212f4-7935-4e3c-b455-be7c825fb834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.034807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1212f4-7935-4e3c-b455-be7c825fb834 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.035111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1212f4-7935-4e3c-b455-be7c825fb834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.040652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1212f4-7935-4e3c-b455-be7c825fb834 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.040652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1212f4-7935-4e3c-b455-be7c825fb834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.040652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1212f4-7935-4e3c-b455-be7c825fb834 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.092042 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dced82cdd834cc0a6869f506b409184', 'request_id': 'req-eaacef53-a229-42a6-8f12-e7844e98db59'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.098114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dced82cdd834cc0a6869f506b409184', 'request_id': 'req-eaacef53-a229-42a6-8f12-e7844e98db59'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.139188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 995/1977] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:16 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:16.143300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1212f4-7935-4e3c-b455-be7c825fb834 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.203762 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1212f4-7935-4e3c-b455-be7c825fb834 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.204523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dced82cdd834cc0a6869f506b409184', 'request_id': 'req-eaacef53-a229-42a6-8f12-e7844e98db59'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.208741 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634d78b-0d0a-4aa8-a3e4-4f0346b4d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.209319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634d78b-0d0a-4aa8-a3e4-4f0346b4d7cf admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.209647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634d78b-0d0a-4aa8-a3e4-4f0346b4d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.209928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634d78b-0d0a-4aa8-a3e4-4f0346b4d7cf admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.210554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634d78b-0d0a-4aa8-a3e4-4f0346b4d7cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.212562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634d78b-0d0a-4aa8-a3e4-4f0346b4d7cf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.217292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] The token cache is being invalidate because project 6dced82cdd834cc0a6869f506b409184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:16.217590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.218247 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.219851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 983/1978] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:15 2022] DELETE /identity/v3/projects/6dced82cdd834cc0a6869f506b409184 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:16.224437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.225768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.294206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacef53-a229-42a6-8f12-e7844e98db59 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.298860 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.299523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.299809 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.300665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] PATH_INFO: `/v3/users/d1d9b4b7032941b5829a41ab59fd4365` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.301876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d9b4b7032941b5829a41ab59fd4365)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.303832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.315203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 996/1979] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:16 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:16.319312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634d78b-0d0a-4aa8-a3e4-4f0346b4d7cf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.321056 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1634d78b-0d0a-4aa8-a3e4-4f0346b4d7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.333726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634d78b-0d0a-4aa8-a3e4-4f0346b4d7cf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.338446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df133-8cba-4990-b30a-2968b71da781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.339219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df133-8cba-4990-b30a-2968b71da781 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.339508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df133-8cba-4990-b30a-2968b71da781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.339789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df133-8cba-4990-b30a-2968b71da781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.340512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df133-8cba-4990-b30a-2968b71da781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.342196 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df133-8cba-4990-b30a-2968b71da781 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.354064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 997/1980] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:16.360675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df133-8cba-4990-b30a-2968b71da781 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.370772 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df133-8cba-4990-b30a-2968b71da781 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.375402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bce02a-46e5-4ecd-9b08-7cfb4dfb62e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.376053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bce02a-46e5-4ecd-9b08-7cfb4dfb62e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.376335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bce02a-46e5-4ecd-9b08-7cfb4dfb62e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.376603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bce02a-46e5-4ecd-9b08-7cfb4dfb62e1 admin admin] PATH_INFO: `/v3/projects/8c9aff04bb12460480c655fdb1069201/users/e31802b93faf499fa558387a609d9350/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.391444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bce02a-46e5-4ecd-9b08-7cfb4dfb62e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9aff04bb12460480c655fdb1069201, user_id=e31802b93faf499fa558387a609d9350, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.394119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bce02a-46e5-4ecd-9b08-7cfb4dfb62e1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.564928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 998/1981] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:16 2022] PUT /identity/v3/projects/8c9aff04bb12460480c655fdb1069201/users/e31802b93faf499fa558387a609d9350/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:16.569513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bce02a-46e5-4ecd-9b08-7cfb4dfb62e1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.592645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d9b4b7032941b5829a41ab59fd4365'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.631064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bce02a-46e5-4ecd-9b08-7cfb4dfb62e1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.635716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93466fe-6509-4d3b-95c1-e8d7d0feea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.640352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93466fe-6509-4d3b-95c1-e8d7d0feea70 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.640352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93466fe-6509-4d3b-95c1-e8d7d0feea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.640352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93466fe-6509-4d3b-95c1-e8d7d0feea70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.640352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93466fe-6509-4d3b-95c1-e8d7d0feea70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.640352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93466fe-6509-4d3b-95c1-e8d7d0feea70 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.649532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 999/1982] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:16.653640 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93466fe-6509-4d3b-95c1-e8d7d0feea70 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.664116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93466fe-6509-4d3b-95c1-e8d7d0feea70 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.668816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0938fb-d44a-405e-9ae7-e550c29393bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.672221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0938fb-d44a-405e-9ae7-e550c29393bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.672221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0938fb-d44a-405e-9ae7-e550c29393bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.672221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0938fb-d44a-405e-9ae7-e550c29393bc admin admin] PATH_INFO: `/v3/projects/8c9aff04bb12460480c655fdb1069201/users/e31802b93faf499fa558387a609d9350/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.672221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0938fb-d44a-405e-9ae7-e550c29393bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9aff04bb12460480c655fdb1069201, user_id=e31802b93faf499fa558387a609d9350, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.674690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0938fb-d44a-405e-9ae7-e550c29393bc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.684654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1000/1983] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:16 2022] PUT /identity/v3/projects/8c9aff04bb12460480c655fdb1069201/users/e31802b93faf499fa558387a609d9350/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:16.692284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d9b4b7032941b5829a41ab59fd4365'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.696713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1338df1-d974-4a04-9766-7e1117ec3d0b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.697012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1338df1-d974-4a04-9766-7e1117ec3d0b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.697376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1338df1-d974-4a04-9766-7e1117ec3d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.699787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d9b4b7032941b5829a41ab59fd4365'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.703319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d9b4b7032941b5829a41ab59fd4365'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.713839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d9b4b7032941b5829a41ab59fd4365'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.720059 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 984/1984] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:16 2022] DELETE /identity/v3/users/d1d9b4b7032941b5829a41ab59fd4365 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:16.726979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a1338df1-d974-4a04-9766-7e1117ec3d0b None None] MFA Rules not processed for user `e31802b93faf499fa558387a609d9350`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:16.728247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a1338df1-d974-4a04-9766-7e1117ec3d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.799452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1001/1985] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:16.810157 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.811709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.884022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370db09-b29a-4f0e-a315-250dff47a297 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.887514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78ed52-925d-49f7-abc5-53db72d99c70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.888134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78ed52-925d-49f7-abc5-53db72d99c70 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.888490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78ed52-925d-49f7-abc5-53db72d99c70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.888716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78ed52-925d-49f7-abc5-53db72d99c70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.898978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78ed52-925d-49f7-abc5-53db72d99c70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.900592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78ed52-925d-49f7-abc5-53db72d99c70 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.911470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 985/1986] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:17.305705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1338df1-d974-4a04-9766-7e1117ec3d0b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:17.307932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a1338df1-d974-4a04-9766-7e1117ec3d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:17.389833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1338df1-d974-4a04-9766-7e1117ec3d0b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.397644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.397644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.397644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.397644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] PATH_INFO: `/v3/projects/51be8dd5b20c4d86b86e56d374867040` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.398013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51be8dd5b20c4d86b86e56d374867040)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.399159 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:17.615967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51be8dd5b20c4d86b86e56d374867040', 'request_id': 'req-3c43b3df-b2c7-45cb-8d83-282042122043'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:17.840589 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51be8dd5b20c4d86b86e56d374867040', 'request_id': 'req-3c43b3df-b2c7-45cb-8d83-282042122043'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:17.848337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51be8dd5b20c4d86b86e56d374867040', 'request_id': 'req-3c43b3df-b2c7-45cb-8d83-282042122043'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:17.859395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] The token cache is being invalidate because project 51be8dd5b20c4d86b86e56d374867040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:17.859685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:17.860334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3c43b3df-b2c7-45cb-8d83-282042122043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:17.861975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1002/1987] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:17 2022] DELETE /identity/v3/projects/51be8dd5b20c4d86b86e56d374867040 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:17.868124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe10b-0532-4893-9dcb-221b1e07c17d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.868611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe10b-0532-4893-9dcb-221b1e07c17d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.868833 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe10b-0532-4893-9dcb-221b1e07c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.888765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1d7fe10b-0532-4893-9dcb-221b1e07c17d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:17.889988 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1d7fe10b-0532-4893-9dcb-221b1e07c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:17.950231 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 986/1988] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:17.960151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ab584-2b62-4df8-82e4-e255901b27c6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.964692 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ab584-2b62-4df8-82e4-e255901b27c6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.964692 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ab584-2b62-4df8-82e4-e255901b27c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.984038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7e9ab584-2b62-4df8-82e4-e255901b27c6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:17.985420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:17.986053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7e9ab584-2b62-4df8-82e4-e255901b27c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:17.999457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1003/1989] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:18.003350 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fe10b-0532-4893-9dcb-221b1e07c17d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.014205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fe10b-0532-4893-9dcb-221b1e07c17d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.020035 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068b86f-7056-47bd-9efe-d512fceaa0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.020761 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068b86f-7056-47bd-9efe-d512fceaa0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.021146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068b86f-7056-47bd-9efe-d512fceaa0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.021519 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068b86f-7056-47bd-9efe-d512fceaa0c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.022612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068b86f-7056-47bd-9efe-d512fceaa0c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:18.023155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068b86f-7056-47bd-9efe-d512fceaa0c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.024855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068b86f-7056-47bd-9efe-d512fceaa0c2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.041371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 987/1990] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:49:18.045343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ab584-2b62-4df8-82e4-e255901b27c6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.055081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ab584-2b62-4df8-82e4-e255901b27c6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.060060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8115c-8a0e-4a8d-8dcd-eeddb79e7245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.060660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8115c-8a0e-4a8d-8dcd-eeddb79e7245 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.060944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8115c-8a0e-4a8d-8dcd-eeddb79e7245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.061333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8115c-8a0e-4a8d-8dcd-eeddb79e7245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.061971 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8115c-8a0e-4a8d-8dcd-eeddb79e7245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.063937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8115c-8a0e-4a8d-8dcd-eeddb79e7245 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.202611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1004/1991] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:18 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:18.207860 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068b86f-7056-47bd-9efe-d512fceaa0c2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.218043 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068b86f-7056-47bd-9efe-d512fceaa0c2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.289936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a33ebe-ff74-4560-ace0-0b1e48374ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.290797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a33ebe-ff74-4560-ace0-0b1e48374ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.291168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a33ebe-ff74-4560-ace0-0b1e48374ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.291492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a33ebe-ff74-4560-ace0-0b1e48374ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.292176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a33ebe-ff74-4560-ace0-0b1e48374ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.301220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a33ebe-ff74-4560-ace0-0b1e48374ee0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.318806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8115c-8a0e-4a8d-8dcd-eeddb79e7245 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.320886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2bb8115c-8a0e-4a8d-8dcd-eeddb79e7245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:18.349409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8115c-8a0e-4a8d-8dcd-eeddb79e7245 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.356561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5babd6-2704-47d3-9dc7-171e6d42d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.358637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5babd6-2704-47d3-9dc7-171e6d42d903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.358637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5babd6-2704-47d3-9dc7-171e6d42d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.358637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5babd6-2704-47d3-9dc7-171e6d42d903 admin admin] PATH_INFO: `/v3/users/15372b0ce2fc44a5b70634ca846a843d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.369628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5babd6-2704-47d3-9dc7-171e6d42d903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15372b0ce2fc44a5b70634ca846a843d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.372815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5babd6-2704-47d3-9dc7-171e6d42d903 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.417942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 988/1992] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:18 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:18.422190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a33ebe-ff74-4560-ace0-0b1e48374ee0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.432330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a33ebe-ff74-4560-ace0-0b1e48374ee0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.437559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddbe59-ee73-4a92-8bdb-42e0d96865b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.437903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddbe59-ee73-4a92-8bdb-42e0d96865b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.438201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddbe59-ee73-4a92-8bdb-42e0d96865b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.438470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddbe59-ee73-4a92-8bdb-42e0d96865b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.439230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddbe59-ee73-4a92-8bdb-42e0d96865b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.441565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddbe59-ee73-4a92-8bdb-42e0d96865b7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.452402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 989/1993] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:18.457232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddbe59-ee73-4a92-8bdb-42e0d96865b7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.468423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddbe59-ee73-4a92-8bdb-42e0d96865b7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.473419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab030809-5c89-48f4-ae35-2962c7978310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.474026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab030809-5c89-48f4-ae35-2962c7978310 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.474307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab030809-5c89-48f4-ae35-2962c7978310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.474581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab030809-5c89-48f4-ae35-2962c7978310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.475267 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab030809-5c89-48f4-ae35-2962c7978310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.476880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab030809-5c89-48f4-ae35-2962c7978310 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.487521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 990/1994] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:18.491288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab030809-5c89-48f4-ae35-2962c7978310 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.501307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab030809-5c89-48f4-ae35-2962c7978310 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.506645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffcd72-a4fe-45a4-95dc-2e2fa0330cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.507375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffcd72-a4fe-45a4-95dc-2e2fa0330cce admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.507666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffcd72-a4fe-45a4-95dc-2e2fa0330cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.507944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffcd72-a4fe-45a4-95dc-2e2fa0330cce admin admin] PATH_INFO: `/v3/projects/9362325e83b746729c51b9737bbaff4a/users/822cc3674b8446b89a2f2b1bf463a915/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.525313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffcd72-a4fe-45a4-95dc-2e2fa0330cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9362325e83b746729c51b9737bbaff4a, user_id=822cc3674b8446b89a2f2b1bf463a915, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.528149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffcd72-a4fe-45a4-95dc-2e2fa0330cce admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.543445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:18.635626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 991/1995] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:18 2022] PUT /identity/v3/projects/9362325e83b746729c51b9737bbaff4a/users/822cc3674b8446b89a2f2b1bf463a915/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:18.646024 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c0815-fd99-4b5a-9157-23d1a79ab0e2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.646525 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c0815-fd99-4b5a-9157-23d1a79ab0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.646804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c0815-fd99-4b5a-9157-23d1a79ab0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.677712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-883c0815-fd99-4b5a-9157-23d1a79ab0e2 None None] MFA Rules not processed for user `822cc3674b8446b89a2f2b1bf463a915`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:18.678675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3f5babd6-2704-47d3-9dc7-171e6d42d903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15372b0ce2fc44a5b70634ca846a843d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.679040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-883c0815-fd99-4b5a-9157-23d1a79ab0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:18.679358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3f5babd6-2704-47d3-9dc7-171e6d42d903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15372b0ce2fc44a5b70634ca846a843d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.679974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3f5babd6-2704-47d3-9dc7-171e6d42d903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15372b0ce2fc44a5b70634ca846a843d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.746448 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 992/1996] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:18.750800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c0815-fd99-4b5a-9157-23d1a79ab0e2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.752170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-883c0815-fd99-4b5a-9157-23d1a79ab0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:18.823719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c0815-fd99-4b5a-9157-23d1a79ab0e2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.828538 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356006-74db-4cea-9b07-fc3bf4a1e07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.829147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356006-74db-4cea-9b07-fc3bf4a1e07f admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.829429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356006-74db-4cea-9b07-fc3bf4a1e07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.829707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356006-74db-4cea-9b07-fc3bf4a1e07f admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.830527 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11356006-74db-4cea-9b07-fc3bf4a1e07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.832759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11356006-74db-4cea-9b07-fc3bf4a1e07f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.914749 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3f5babd6-2704-47d3-9dc7-171e6d42d903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15372b0ce2fc44a5b70634ca846a843d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.930247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3f5babd6-2704-47d3-9dc7-171e6d42d903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15372b0ce2fc44a5b70634ca846a843d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.944946 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1005/1997] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:18 2022] DELETE /identity/v3/users/15372b0ce2fc44a5b70634ca846a843d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:18.950172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18d99c-0429-43c7-98f1-0ed2a0e1ae15 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.950172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18d99c-0429-43c7-98f1-0ed2a0e1ae15 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.950172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18d99c-0429-43c7-98f1-0ed2a0e1ae15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.973665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 993/1998] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:18 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:18.978050 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5c18d99c-0429-43c7-98f1-0ed2a0e1ae15 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:18.978746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5c18d99c-0429-43c7-98f1-0ed2a0e1ae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:18.980200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356006-74db-4cea-9b07-fc3bf4a1e07f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.067558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1006/1999] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:19.080329 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18d99c-0429-43c7-98f1-0ed2a0e1ae15 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.083738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5c18d99c-0429-43c7-98f1-0ed2a0e1ae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:19.099876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356006-74db-4cea-9b07-fc3bf4a1e07f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.110762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ef3d5-5982-4899-9874-75b823829bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.113785 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ef3d5-5982-4899-9874-75b823829bea admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.114059 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ef3d5-5982-4899-9874-75b823829bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.114335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ef3d5-5982-4899-9874-75b823829bea admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.115007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ef3d5-5982-4899-9874-75b823829bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.117002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ef3d5-5982-4899-9874-75b823829bea admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.158035 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18d99c-0429-43c7-98f1-0ed2a0e1ae15 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.162686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127985e5-e7f4-4a74-a1f8-4c3200c6a643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.163528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127985e5-e7f4-4a74-a1f8-4c3200c6a643 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.163818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127985e5-e7f4-4a74-a1f8-4c3200c6a643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.164101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127985e5-e7f4-4a74-a1f8-4c3200c6a643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.174139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127985e5-e7f4-4a74-a1f8-4c3200c6a643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.175785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127985e5-e7f4-4a74-a1f8-4c3200c6a643 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.186766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1007/2000] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:19.247143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 994/2001] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:18 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:19.248962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127985e5-e7f4-4a74-a1f8-4c3200c6a643 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.259268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127985e5-e7f4-4a74-a1f8-4c3200c6a643 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.264151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d9188-0185-4766-9d4b-2acdff8dc089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.264769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d9188-0185-4766-9d4b-2acdff8dc089 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.265049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d9188-0185-4766-9d4b-2acdff8dc089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.265322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d9188-0185-4766-9d4b-2acdff8dc089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.269903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d9188-0185-4766-9d4b-2acdff8dc089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.272190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d9188-0185-4766-9d4b-2acdff8dc089 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.282757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1008/2002] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:19.286930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ef3d5-5982-4899-9874-75b823829bea admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.297024 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ef3d5-5982-4899-9874-75b823829bea admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.302195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968077e-1594-4e34-83ba-376ac9ae1528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.306224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968077e-1594-4e34-83ba-376ac9ae1528 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.306224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968077e-1594-4e34-83ba-376ac9ae1528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.306224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968077e-1594-4e34-83ba-376ac9ae1528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.306224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968077e-1594-4e34-83ba-376ac9ae1528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.306224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968077e-1594-4e34-83ba-376ac9ae1528 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.317336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 995/2003] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:19.321536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d9188-0185-4766-9d4b-2acdff8dc089 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.331766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d9188-0185-4766-9d4b-2acdff8dc089 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.336730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6175cb-bcda-4b2e-961d-6b38d5c065dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.337396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6175cb-bcda-4b2e-961d-6b38d5c065dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.337728 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6175cb-bcda-4b2e-961d-6b38d5c065dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.338010 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6175cb-bcda-4b2e-961d-6b38d5c065dc admin admin] PATH_INFO: `/v3/projects/52bbb822d3014f28b692490d743eac27/users/68899382005146acb6a28497c7614158/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.353429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6175cb-bcda-4b2e-961d-6b38d5c065dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bbb822d3014f28b692490d743eac27, user_id=68899382005146acb6a28497c7614158, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.356281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6175cb-bcda-4b2e-961d-6b38d5c065dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.445380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968077e-1594-4e34-83ba-376ac9ae1528 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.447388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f968077e-1594-4e34-83ba-376ac9ae1528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:19.460912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968077e-1594-4e34-83ba-376ac9ae1528 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.466145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.466988 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.467442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.467887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] PATH_INFO: `/v3/users/57673e9e7781435d971aca84980e2601` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.469220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57673e9e7781435d971aca84980e2601)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.471357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.484427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1009/2004] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:19 2022] PUT /identity/v3/projects/52bbb822d3014f28b692490d743eac27/users/68899382005146acb6a28497c7614158/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:19.497439 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2a706-fd49-4d4c-acaf-03ef6e76d1b3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.497825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2a706-fd49-4d4c-acaf-03ef6e76d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.498237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2a706-fd49-4d4c-acaf-03ef6e76d1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.540696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9ff2a706-fd49-4d4c-acaf-03ef6e76d1b3 None None] MFA Rules not processed for user `68899382005146acb6a28497c7614158`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:19.542094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9ff2a706-fd49-4d4c-acaf-03ef6e76d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:19.638226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1010/2005] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:19.641294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2a706-fd49-4d4c-acaf-03ef6e76d1b3 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.704266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2a706-fd49-4d4c-acaf-03ef6e76d1b3 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.709236 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af395d49-64d6-4638-b163-fdac8a8e99d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.709843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af395d49-64d6-4638-b163-fdac8a8e99d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.710119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af395d49-64d6-4638-b163-fdac8a8e99d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.710411 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af395d49-64d6-4638-b163-fdac8a8e99d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.711061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af395d49-64d6-4638-b163-fdac8a8e99d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.713007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af395d49-64d6-4638-b163-fdac8a8e99d4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.761098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57673e9e7781435d971aca84980e2601'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:19.871006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57673e9e7781435d971aca84980e2601'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:19.879825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57673e9e7781435d971aca84980e2601'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:19.880259 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1011/2006] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:19 2022] POST /identity/v3/projects => generated 375 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:19.881116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af395d49-64d6-4638-b163-fdac8a8e99d4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.881248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57673e9e7781435d971aca84980e2601'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:19.882732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-af395d49-64d6-4638-b163-fdac8a8e99d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:19.895817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57673e9e7781435d971aca84980e2601'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:19.902000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 996/2007] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:19 2022] DELETE /identity/v3/users/57673e9e7781435d971aca84980e2601 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:19.905595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.905595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:19.948557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af395d49-64d6-4638-b163-fdac8a8e99d4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.974569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9993-bb72-45d7-aa84-cec96f2d41a9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.979326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df5748-5b13-44d0-ba2f-bd1b9803af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.979984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df5748-5b13-44d0-ba2f-bd1b9803af4c admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.980274 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df5748-5b13-44d0-ba2f-bd1b9803af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.980552 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df5748-5b13-44d0-ba2f-bd1b9803af4c admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.981209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df5748-5b13-44d0-ba2f-bd1b9803af4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.983207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df5748-5b13-44d0-ba2f-bd1b9803af4c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.006426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.007160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.007450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.007736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] PATH_INFO: `/v3/projects/74c2f60f6c824f71a9d7be39f11b48aa` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.008925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c2f60f6c824f71a9d7be39f11b48aa)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.010864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.074697 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 997/2008] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:19 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:20.076168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e5c7-ff99-45b0-9d47-bce44a092f27 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.076465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e5c7-ff99-45b0-9d47-bce44a092f27 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.076745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6e5c7-ff99-45b0-9d47-bce44a092f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.096647 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bfa6e5c7-ff99-45b0-9d47-bce44a092f27 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:20.098705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bfa6e5c7-ff99-45b0-9d47-bce44a092f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.107299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 998/2009] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:20.110646 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6e5c7-ff99-45b0-9d47-bce44a092f27 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.118767 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c2f60f6c824f71a9d7be39f11b48aa', 'request_id': 'req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:20.118931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6e5c7-ff99-45b0-9d47-bce44a092f27 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.175505 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2297c-1350-4ac1-b529-2b2ef18d1c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.176031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2297c-1350-4ac1-b529-2b2ef18d1c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.176336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2297c-1350-4ac1-b529-2b2ef18d1c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.176613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2297c-1350-4ac1-b529-2b2ef18d1c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.177257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2297c-1350-4ac1-b529-2b2ef18d1c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.179107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2297c-1350-4ac1-b529-2b2ef18d1c09 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.182657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c2f60f6c824f71a9d7be39f11b48aa', 'request_id': 'req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:20.190398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 999/2010] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:20.190557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c2f60f6c824f71a9d7be39f11b48aa', 'request_id': 'req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:20.199482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2297c-1350-4ac1-b529-2b2ef18d1c09 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.199482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0bb2297c-1350-4ac1-b529-2b2ef18d1c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.204048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] The token cache is being invalidate because project 74c2f60f6c824f71a9d7be39f11b48aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:20.204353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:20.205064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:20.207761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1012/2011] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:19 2022] DELETE /identity/v3/projects/74c2f60f6c824f71a9d7be39f11b48aa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:20.208225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.209667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.223568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2737f9-8b1f-4785-a616-0bd3ca2d16aa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.228570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e77bee-e528-4e64-af11-db0076de8690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.229332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e77bee-e528-4e64-af11-db0076de8690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.229613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e77bee-e528-4e64-af11-db0076de8690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.229891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e77bee-e528-4e64-af11-db0076de8690 admin admin] PATH_INFO: `/v3/projects/8a697903938b4a9c835fd071aaff63b5/users/e93a0596c370494cb9155b0b164e9748/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.245397 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e77bee-e528-4e64-af11-db0076de8690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a697903938b4a9c835fd071aaff63b5, user_id=e93a0596c370494cb9155b0b164e9748, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.248161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e77bee-e528-4e64-af11-db0076de8690 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.253541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:20.254892 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2297c-1350-4ac1-b529-2b2ef18d1c09 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.258737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acdc06-e339-4bbd-89b2-1baab06c3d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.262818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acdc06-e339-4bbd-89b2-1baab06c3d66 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.262818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acdc06-e339-4bbd-89b2-1baab06c3d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.262818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acdc06-e339-4bbd-89b2-1baab06c3d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.262818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a6acdc06-e339-4bbd-89b2-1baab06c3d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.274205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acdc06-e339-4bbd-89b2-1baab06c3d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.275837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acdc06-e339-4bbd-89b2-1baab06c3d66 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.287605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1000/2012] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:20.288472 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acdc06-e339-4bbd-89b2-1baab06c3d66 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.289831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a6acdc06-e339-4bbd-89b2-1baab06c3d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.302793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acdc06-e339-4bbd-89b2-1baab06c3d66 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.308252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.308894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.309193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.309505 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] PATH_INFO: `/v3/users/e31802b93faf499fa558387a609d9350` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.310731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31802b93faf499fa558387a609d9350)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.316686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.325843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1013/2013] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:20 2022] PUT /identity/v3/projects/8a697903938b4a9c835fd071aaff63b5/users/e93a0596c370494cb9155b0b164e9748/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:20.326975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e77bee-e528-4e64-af11-db0076de8690 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.394933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:20.398883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e77bee-e528-4e64-af11-db0076de8690 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.403797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c5938-6834-4620-b038-44ef6f0520ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.404415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c5938-6834-4620-b038-44ef6f0520ae admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.404701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c5938-6834-4620-b038-44ef6f0520ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.404981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c5938-6834-4620-b038-44ef6f0520ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.405637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c5938-6834-4620-b038-44ef6f0520ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.407309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c5938-6834-4620-b038-44ef6f0520ae admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.418008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1014/2014] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:20.422090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c5938-6834-4620-b038-44ef6f0520ae admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.431960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c5938-6834-4620-b038-44ef6f0520ae admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.436544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bcd4b-cf9b-49ae-b699-4605234471e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.437248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcd4b-cf9b-49ae-b699-4605234471e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.437533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcd4b-cf9b-49ae-b699-4605234471e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.437810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcd4b-cf9b-49ae-b699-4605234471e0 admin admin] PATH_INFO: `/v3/projects/8a697903938b4a9c835fd071aaff63b5/users/e93a0596c370494cb9155b0b164e9748/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.439766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bcd4b-cf9b-49ae-b699-4605234471e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a697903938b4a9c835fd071aaff63b5, user_id=e93a0596c370494cb9155b0b164e9748, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.442982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bcd4b-cf9b-49ae-b699-4605234471e0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.454116 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1015/2015] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:20 2022] PUT /identity/v3/projects/8a697903938b4a9c835fd071aaff63b5/users/e93a0596c370494cb9155b0b164e9748/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:20.466062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72291c7-0d6f-4374-852e-4a3224b1c6c6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.466359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72291c7-0d6f-4374-852e-4a3224b1c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.466619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72291c7-0d6f-4374-852e-4a3224b1c6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.499434 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b72291c7-0d6f-4374-852e-4a3224b1c6c6 None None] MFA Rules not processed for user `e93a0596c370494cb9155b0b164e9748`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:20.500763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b72291c7-0d6f-4374-852e-4a3224b1c6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.524936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31802b93faf499fa558387a609d9350'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:20.587204 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1016/2016] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:20.596234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72291c7-0d6f-4374-852e-4a3224b1c6c6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.597768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b72291c7-0d6f-4374-852e-4a3224b1c6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.608565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31802b93faf499fa558387a609d9350'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:20.621062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31802b93faf499fa558387a609d9350'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:20.622279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31802b93faf499fa558387a609d9350'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:20.639170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31802b93faf499fa558387a609d9350'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:20.647241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1001/2017] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:20 2022] DELETE /identity/v3/users/e31802b93faf499fa558387a609d9350 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:20.670075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72291c7-0d6f-4374-852e-4a3224b1c6c6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.743067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00c566-9a2e-4774-806b-6ba980451cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.744136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c566-9a2e-4774-806b-6ba980451cdf service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.744617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c566-9a2e-4774-806b-6ba980451cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.745134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c566-9a2e-4774-806b-6ba980451cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.747383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fc00c566-9a2e-4774-806b-6ba980451cdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.824617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00c566-9a2e-4774-806b-6ba980451cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.826074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00c566-9a2e-4774-806b-6ba980451cdf service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.836409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1017/2018] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:20.905167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.906799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.988487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff1c7a-e64d-455d-8b53-c5c13acda39c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.996651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.997512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.013324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.013324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] PATH_INFO: `/v3/projects/a40b38a0b6254bacafd3f8c898b15688` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.013324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40b38a0b6254bacafd3f8c898b15688)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:21.013324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:21.155443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40b38a0b6254bacafd3f8c898b15688', 'request_id': 'req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.161820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40b38a0b6254bacafd3f8c898b15688', 'request_id': 'req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.201479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00c566-9a2e-4774-806b-6ba980451cdf service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:21.202906 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fc00c566-9a2e-4774-806b-6ba980451cdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:21.218338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00c566-9a2e-4774-806b-6ba980451cdf service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:21.251466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40b38a0b6254bacafd3f8c898b15688', 'request_id': 'req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.264921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] The token cache is being invalidate because project a40b38a0b6254bacafd3f8c898b15688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:21.265310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.265983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.267734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1002/2019] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:20 2022] DELETE /identity/v3/projects/a40b38a0b6254bacafd3f8c898b15688 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:21.272549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:21.273943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:21.288150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:21.288914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.289339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.289524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] PATH_INFO: `/v3/projects/8c9aff04bb12460480c655fdb1069201` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.290773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9aff04bb12460480c655fdb1069201)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:21.292735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:21.338098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfc4ae-50de-40f8-9381-2fcd4bacc31b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:21.342900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:21.343574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.343857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.344136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] PATH_INFO: `/v3/users/0dbc6b9287994479b469a686a28e64b2` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.345285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dbc6b9287994479b469a686a28e64b2)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:21.347297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:21.452356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9aff04bb12460480c655fdb1069201', 'request_id': 'req-c000a487-95d6-41e2-aa44-7476ba3439de'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.524083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9aff04bb12460480c655fdb1069201', 'request_id': 'req-c000a487-95d6-41e2-aa44-7476ba3439de'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.530548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9aff04bb12460480c655fdb1069201', 'request_id': 'req-c000a487-95d6-41e2-aa44-7476ba3439de'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.541710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] The token cache is being invalidate because project 8c9aff04bb12460480c655fdb1069201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:21.542006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.542634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c000a487-95d6-41e2-aa44-7476ba3439de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.544205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1018/2020] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:21 2022] DELETE /identity/v3/projects/8c9aff04bb12460480c655fdb1069201 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:21.549338 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57df05-0fd4-42c4-9a0d-e3b10fe34fb8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.549633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57df05-0fd4-42c4-9a0d-e3b10fe34fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.550539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57df05-0fd4-42c4-9a0d-e3b10fe34fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.571174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5c57df05-0fd4-42c4-9a0d-e3b10fe34fb8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:21.574424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5c57df05-0fd4-42c4-9a0d-e3b10fe34fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:21.598581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dbc6b9287994479b469a686a28e64b2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.637038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1019/2021] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:21.645904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04309983-dd53-402d-9dee-da7231d065a6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.646200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04309983-dd53-402d-9dee-da7231d065a6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.646482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04309983-dd53-402d-9dee-da7231d065a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.666142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-04309983-dd53-402d-9dee-da7231d065a6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:21.667530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-04309983-dd53-402d-9dee-da7231d065a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:21.676311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1020/2022] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:21.680107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dbc6b9287994479b469a686a28e64b2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.680549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04309983-dd53-402d-9dee-da7231d065a6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:21.688401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dbc6b9287994479b469a686a28e64b2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.689301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dbc6b9287994479b469a686a28e64b2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.691536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04309983-dd53-402d-9dee-da7231d065a6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:21.697022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a4caf-2c0e-4492-b9f2-e025644bab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:21.697703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a4caf-2c0e-4492-b9f2-e025644bab43 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.698092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a4caf-2c0e-4492-b9f2-e025644bab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.698435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a4caf-2c0e-4492-b9f2-e025644bab43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.699195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a4caf-2c0e-4492-b9f2-e025644bab43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:21.699576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a4caf-2c0e-4492-b9f2-e025644bab43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:21.702311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a4caf-2c0e-4492-b9f2-e025644bab43 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:21.703926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dbc6b9287994479b469a686a28e64b2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:21.710149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1003/2023] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:21 2022] DELETE /identity/v3/users/0dbc6b9287994479b469a686a28e64b2 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:21.719928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1021/2024] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:49:21.731826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:21.735896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:21.818124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770aa31-242e-47b6-a5f5-5cbbf0b27b93 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:21.823894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2f79-851a-4331-a988-fd60c1902fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:21.824851 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2f79-851a-4331-a988-fd60c1902fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.825197 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2f79-851a-4331-a988-fd60c1902fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.825605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2f79-851a-4331-a988-fd60c1902fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.826243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e2f79-851a-4331-a988-fd60c1902fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:21.828233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e2f79-851a-4331-a988-fd60c1902fb1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:21.972793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1004/2025] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:21 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:21.974671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a4caf-2c0e-4492-b9f2-e025644bab43 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:21.987078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a4caf-2c0e-4492-b9f2-e025644bab43 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:22.083846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca128e94-841e-4788-bb4b-622205e0abf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:22.084614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128e94-841e-4788-bb4b-622205e0abf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.084998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128e94-841e-4788-bb4b-622205e0abf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.085376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128e94-841e-4788-bb4b-622205e0abf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.086123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca128e94-841e-4788-bb4b-622205e0abf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:22.088335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca128e94-841e-4788-bb4b-622205e0abf4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:22.212240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1022/2026] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:21 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:22.216294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2f79-851a-4331-a988-fd60c1902fb1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:22.228412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2f79-851a-4331-a988-fd60c1902fb1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:22.237917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca128e94-841e-4788-bb4b-622205e0abf4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:22.239812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abba0fa-30a4-45cc-9a96-321b91475cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:22.240889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abba0fa-30a4-45cc-9a96-321b91475cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.241335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abba0fa-30a4-45cc-9a96-321b91475cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.241727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abba0fa-30a4-45cc-9a96-321b91475cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.242561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abba0fa-30a4-45cc-9a96-321b91475cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:22.244402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abba0fa-30a4-45cc-9a96-321b91475cf3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:22.247137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ca128e94-841e-4788-bb4b-622205e0abf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:22.257403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1005/2027] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:22.260225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca128e94-841e-4788-bb4b-622205e0abf4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:22.264251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abba0fa-30a4-45cc-9a96-321b91475cf3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:22.267802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:22.268817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.269489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.269921 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] PATH_INFO: `/v3/projects/baa43cb016734a188cf5fbc859a477d9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.271926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa43cb016734a188cf5fbc859a477d9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:22.274276 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:22.276370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abba0fa-30a4-45cc-9a96-321b91475cf3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:22.281762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcf111-500e-45bb-a428-a045f31b781b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:22.282387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcf111-500e-45bb-a428-a045f31b781b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.282769 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcf111-500e-45bb-a428-a045f31b781b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.283069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcf111-500e-45bb-a428-a045f31b781b admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.283778 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcf111-500e-45bb-a428-a045f31b781b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:22.287038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcf111-500e-45bb-a428-a045f31b781b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:22.301429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1006/2028] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:22.302490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcf111-500e-45bb-a428-a045f31b781b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:22.310683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:22.314745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcf111-500e-45bb-a428-a045f31b781b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:22.319613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e1dce-2878-426b-beef-2545c5bdc950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:22.320303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e1dce-2878-426b-beef-2545c5bdc950 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.320589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e1dce-2878-426b-beef-2545c5bdc950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.320870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e1dce-2878-426b-beef-2545c5bdc950 admin admin] PATH_INFO: `/v3/projects/38b4211749eb40adafc9fd5bf924d49d/users/a35c4f80b4f94c3bbe9643fc6d4d560d/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.336743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e1dce-2878-426b-beef-2545c5bdc950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b4211749eb40adafc9fd5bf924d49d, user_id=a35c4f80b4f94c3bbe9643fc6d4d560d, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:22.339487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e1dce-2878-426b-beef-2545c5bdc950 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:22.493261 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1007/2029] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:22 2022] PUT /identity/v3/projects/38b4211749eb40adafc9fd5bf924d49d/users/a35c4f80b4f94c3bbe9643fc6d4d560d/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:22.498256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657564e0-84d5-45a7-8ce6-ab2869cee374 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.498541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657564e0-84d5-45a7-8ce6-ab2869cee374 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.498818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657564e0-84d5-45a7-8ce6-ab2869cee374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.501764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa43cb016734a188cf5fbc859a477d9', 'request_id': 'req-29e0f447-a088-4c73-9194-1231ac79deb2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:22.517634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-657564e0-84d5-45a7-8ce6-ab2869cee374 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:22.519394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-657564e0-84d5-45a7-8ce6-ab2869cee374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:22.577729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1008/2030] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:22.588416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657564e0-84d5-45a7-8ce6-ab2869cee374 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:22.589791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-657564e0-84d5-45a7-8ce6-ab2869cee374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:22.609979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa43cb016734a188cf5fbc859a477d9', 'request_id': 'req-29e0f447-a088-4c73-9194-1231ac79deb2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:22.616189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa43cb016734a188cf5fbc859a477d9', 'request_id': 'req-29e0f447-a088-4c73-9194-1231ac79deb2'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:22.627732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] The token cache is being invalidate because project baa43cb016734a188cf5fbc859a477d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:22.628039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:22.628711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-29e0f447-a088-4c73-9194-1231ac79deb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:22.630235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1023/2031] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:22 2022] DELETE /identity/v3/projects/baa43cb016734a188cf5fbc859a477d9 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:22.636137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418fd3-227b-4ae1-86ad-8d5be438779c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.636425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418fd3-227b-4ae1-86ad-8d5be438779c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.636725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418fd3-227b-4ae1-86ad-8d5be438779c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.648405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657564e0-84d5-45a7-8ce6-ab2869cee374 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:22.652517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2dc67-88c4-44fd-9e7d-5a0727447d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:22.653149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2dc67-88c4-44fd-9e7d-5a0727447d4f service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.653556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2dc67-88c4-44fd-9e7d-5a0727447d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.653783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2dc67-88c4-44fd-9e7d-5a0727447d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.655689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c1b2dc67-88c4-44fd-9e7d-5a0727447d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:22.656997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b2418fd3-227b-4ae1-86ad-8d5be438779c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:22.658090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b2418fd3-227b-4ae1-86ad-8d5be438779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:22.668612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1024/2032] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:22.676456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2dc67-88c4-44fd-9e7d-5a0727447d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:22.677523 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d541b-33e7-4cd7-bac0-ae52220bde82 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.677970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d541b-33e7-4cd7-bac0-ae52220bde82 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.678141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2dc67-88c4-44fd-9e7d-5a0727447d4f service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:22.678248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d541b-33e7-4cd7-bac0-ae52220bde82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.689350 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1009/2033] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:22.699291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:22.699291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c02d541b-33e7-4cd7-bac0-ae52220bde82 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:22.700355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c02d541b-33e7-4cd7-bac0-ae52220bde82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:22.713597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1025/2034] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:22.717920 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2dc67-88c4-44fd-9e7d-5a0727447d4f service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:22.727974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2dc67-88c4-44fd-9e7d-5a0727447d4f service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:22.733016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabec2f3-4aa3-4c0b-8c1a-ffeeef588117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:22.733992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabec2f3-4aa3-4c0b-8c1a-ffeeef588117 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.733992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabec2f3-4aa3-4c0b-8c1a-ffeeef588117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.734251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabec2f3-4aa3-4c0b-8c1a-ffeeef588117 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.734794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabec2f3-4aa3-4c0b-8c1a-ffeeef588117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:22.735179 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabec2f3-4aa3-4c0b-8c1a-ffeeef588117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:22.736797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabec2f3-4aa3-4c0b-8c1a-ffeeef588117 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:22.748969 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1010/2035] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:22.753763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d541b-33e7-4cd7-bac0-ae52220bde82 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:22.763140 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d541b-33e7-4cd7-bac0-ae52220bde82 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:22.767823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f8c13-13db-449c-87bc-f4b439d6fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:22.768498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8c13-13db-449c-87bc-f4b439d6fdda admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.769304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8c13-13db-449c-87bc-f4b439d6fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.769576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8c13-13db-449c-87bc-f4b439d6fdda admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.770212 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f8c13-13db-449c-87bc-f4b439d6fdda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:22.772156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f8c13-13db-449c-87bc-f4b439d6fdda admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:22.962365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1026/2036] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:22 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:22.966692 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabec2f3-4aa3-4c0b-8c1a-ffeeef588117 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:22.977444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabec2f3-4aa3-4c0b-8c1a-ffeeef588117 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:23.043684 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba556e-1675-4464-b727-459559ed96cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:23.050406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba556e-1675-4464-b727-459559ed96cf admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:23.050406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba556e-1675-4464-b727-459559ed96cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:23.050406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba556e-1675-4464-b727-459559ed96cf admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:23.050406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba556e-1675-4464-b727-459559ed96cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:23.050406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba556e-1675-4464-b727-459559ed96cf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:23.170668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1011/2037] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:22 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:23.171560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f8c13-13db-449c-87bc-f4b439d6fdda admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:23.192119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f8c13-13db-449c-87bc-f4b439d6fdda admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:23.197755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebd0e6-32b4-4b05-8d71-f37e02569837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:23.198385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebd0e6-32b4-4b05-8d71-f37e02569837 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:23.198671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebd0e6-32b4-4b05-8d71-f37e02569837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:23.198947 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebd0e6-32b4-4b05-8d71-f37e02569837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:23.199659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebd0e6-32b4-4b05-8d71-f37e02569837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:23.201744 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebd0e6-32b4-4b05-8d71-f37e02569837 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:23.215625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1027/2038] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:23.224284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba556e-1675-4464-b727-459559ed96cf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:23.234707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba556e-1675-4464-b727-459559ed96cf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:23.241210 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259afc5-5380-45ab-957b-1a00ffc63df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:23.241936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259afc5-5380-45ab-957b-1a00ffc63df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:23.242230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259afc5-5380-45ab-957b-1a00ffc63df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:23.242471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259afc5-5380-45ab-957b-1a00ffc63df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:23.243150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259afc5-5380-45ab-957b-1a00ffc63df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:23.244834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259afc5-5380-45ab-957b-1a00ffc63df6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:23.256712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1012/2039] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:23.264339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebd0e6-32b4-4b05-8d71-f37e02569837 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:23.274999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebd0e6-32b4-4b05-8d71-f37e02569837 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:23.279720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8647be-3240-4be0-b063-21ef6a56532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:23.280379 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8647be-3240-4be0-b063-21ef6a56532e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:23.280663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8647be-3240-4be0-b063-21ef6a56532e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:23.280939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8647be-3240-4be0-b063-21ef6a56532e admin admin] PATH_INFO: `/v3/projects/417d5a6c94a942a5a8260dfa890a606e/users/d09444e34ae84874a9bef14b677b6229/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:23.297227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8647be-3240-4be0-b063-21ef6a56532e admin admin] RBAC: Authorizing `identity:create_grant(project_id=417d5a6c94a942a5a8260dfa890a606e, user_id=d09444e34ae84874a9bef14b677b6229, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:23.300017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8647be-3240-4be0-b063-21ef6a56532e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:23.412162 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1028/2040] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:23 2022] PUT /identity/v3/projects/417d5a6c94a942a5a8260dfa890a606e/users/d09444e34ae84874a9bef14b677b6229/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:23.422898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c477d0-0eaa-4a57-81ba-d5547b8b88b4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:23.423337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c477d0-0eaa-4a57-81ba-d5547b8b88b4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:23.423681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c477d0-0eaa-4a57-81ba-d5547b8b88b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:23.458622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a0c477d0-0eaa-4a57-81ba-d5547b8b88b4 None None] MFA Rules not processed for user `d09444e34ae84874a9bef14b677b6229`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:23.459887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a0c477d0-0eaa-4a57-81ba-d5547b8b88b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:23.494681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:23.533388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1013/2041] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:23.545934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8647be-3240-4be0-b063-21ef6a56532e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:23.548999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5f8647be-3240-4be0-b063-21ef6a56532e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:23.629321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8647be-3240-4be0-b063-21ef6a56532e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:23.633058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33423c93-7d5f-4eef-a733-3a3d20aff429 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6955fc5b81a040f686e21621ea968a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:23.638883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33423c93-7d5f-4eef-a733-3a3d20aff429 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:23.638883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33423c93-7d5f-4eef-a733-3a3d20aff429 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:23.638883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33423c93-7d5f-4eef-a733-3a3d20aff429 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:23.642943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33423c93-7d5f-4eef-a733-3a3d20aff429 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:23.644500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33423c93-7d5f-4eef-a733-3a3d20aff429 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:23.654025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1029/2042] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:24.053391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c477d0-0eaa-4a57-81ba-d5547b8b88b4 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:24.057307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a0c477d0-0eaa-4a57-81ba-d5547b8b88b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:24.119595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c477d0-0eaa-4a57-81ba-d5547b8b88b4 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:24.123409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2e612-774d-4791-85f0-f48608e96f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:24.124044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e612-774d-4791-85f0-f48608e96f3d service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:24.124361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e612-774d-4791-85f0-f48608e96f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:24.124640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e612-774d-4791-85f0-f48608e96f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:24.127499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ece2e612-774d-4791-85f0-f48608e96f3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:24.193577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2e612-774d-4791-85f0-f48608e96f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:24.195272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2e612-774d-4791-85f0-f48608e96f3d service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:24.204936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1014/2043] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:25.006681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572646d-1b82-45a8-9315-1cd79322dceb None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:25.007200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572646d-1b82-45a8-9315-1cd79322dceb None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:25.007297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572646d-1b82-45a8-9315-1cd79322dceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:25.062245 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9572646d-1b82-45a8-9315-1cd79322dceb None None] MFA Rules not processed for user `a35c4f80b4f94c3bbe9643fc6d4d560d`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:25.079614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9572646d-1b82-45a8-9315-1cd79322dceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:25.153525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1030/2044] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:25.158631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2e612-774d-4791-85f0-f48608e96f3d service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:25.160356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ece2e612-774d-4791-85f0-f48608e96f3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:25.242491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2e612-774d-4791-85f0-f48608e96f3d service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:25.248199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f767a-eb85-4823-89cb-42b2f2dcf05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:25.248900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f767a-eb85-4823-89cb-42b2f2dcf05e admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:25.249251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f767a-eb85-4823-89cb-42b2f2dcf05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:25.249600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f767a-eb85-4823-89cb-42b2f2dcf05e admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:25.250309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f767a-eb85-4823-89cb-42b2f2dcf05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:25.252349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f767a-eb85-4823-89cb-42b2f2dcf05e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:25.256420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:25.378910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1015/2045] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:25 2022] POST /identity/v3/projects => generated 373 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:25.383461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572646d-1b82-45a8-9315-1cd79322dceb None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:25.397692 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572646d-1b82-45a8-9315-1cd79322dceb None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:25.457854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d030-1f33-44ac-8379-ae015e3b71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:25.458528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d030-1f33-44ac-8379-ae015e3b71ef admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:25.458816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d030-1f33-44ac-8379-ae015e3b71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:25.459122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d030-1f33-44ac-8379-ae015e3b71ef admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:25.459824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2d030-1f33-44ac-8379-ae015e3b71ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:25.461768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2d030-1f33-44ac-8379-ae015e3b71ef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:25.539463 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1031/2046] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:25 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:25.544301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f767a-eb85-4823-89cb-42b2f2dcf05e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:25.558540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f767a-eb85-4823-89cb-42b2f2dcf05e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:25.569483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f78e5-6a72-422f-a604-fdb84d4330c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:25.575895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:25.576888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f78e5-6a72-422f-a604-fdb84d4330c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:25.582908 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f78e5-6a72-422f-a604-fdb84d4330c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:25.582908 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f78e5-6a72-422f-a604-fdb84d4330c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:25.582908 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f78e5-6a72-422f-a604-fdb84d4330c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:25.582908 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f78e5-6a72-422f-a604-fdb84d4330c0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:25.597519 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1016/2047] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:25.601858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d030-1f33-44ac-8379-ae015e3b71ef admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:25.613912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d030-1f33-44ac-8379-ae015e3b71ef admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:25.620574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb09c9-b198-4f36-a846-be4b52449a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:25.621777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb09c9-b198-4f36-a846-be4b52449a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:25.622313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb09c9-b198-4f36-a846-be4b52449a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:25.622640 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb09c9-b198-4f36-a846-be4b52449a6c admin admin] PATH_INFO: `/v3/projects/4eb66b42217945a19674593667eb4d24/users/ea1c683cbd9e4f1cae1a833ddd1b980a/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:25.644013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb09c9-b198-4f36-a846-be4b52449a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb66b42217945a19674593667eb4d24, user_id=ea1c683cbd9e4f1cae1a833ddd1b980a, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:25.647467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb09c9-b198-4f36-a846-be4b52449a6c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:25.785715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1032/2048] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:25 2022] PUT /identity/v3/projects/4eb66b42217945a19674593667eb4d24/users/ea1c683cbd9e4f1cae1a833ddd1b980a/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:25.786860 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f78e5-6a72-422f-a604-fdb84d4330c0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:25.796796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f78e5-6a72-422f-a604-fdb84d4330c0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:25.860155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e036a51-f2cb-4aa3-8f26-63645bd3be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:25.860777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e036a51-f2cb-4aa3-8f26-63645bd3be64 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:25.861057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e036a51-f2cb-4aa3-8f26-63645bd3be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:25.861331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e036a51-f2cb-4aa3-8f26-63645bd3be64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:25.862735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e036a51-f2cb-4aa3-8f26-63645bd3be64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:25.868831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e036a51-f2cb-4aa3-8f26-63645bd3be64 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:25.875409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1017/2049] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:25.879740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb09c9-b198-4f36-a846-be4b52449a6c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:25.892305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb09c9-b198-4f36-a846-be4b52449a6c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:25.897553 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc54ef-461c-40b6-9d96-aea5978165f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:25.898228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc54ef-461c-40b6-9d96-aea5978165f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:25.898502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc54ef-461c-40b6-9d96-aea5978165f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:25.898901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc54ef-461c-40b6-9d96-aea5978165f9 admin admin] PATH_INFO: `/v3/projects/4eb66b42217945a19674593667eb4d24/users/ea1c683cbd9e4f1cae1a833ddd1b980a/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:25.903099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc54ef-461c-40b6-9d96-aea5978165f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb66b42217945a19674593667eb4d24, user_id=ea1c683cbd9e4f1cae1a833ddd1b980a, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:25.905276 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc54ef-461c-40b6-9d96-aea5978165f9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:25.917918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:25.923622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1033/2050] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:25 2022] PUT /identity/v3/projects/4eb66b42217945a19674593667eb4d24/users/ea1c683cbd9e4f1cae1a833ddd1b980a/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:26.402243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e036a51-f2cb-4aa3-8f26-63645bd3be64 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:26.478161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e036a51-f2cb-4aa3-8f26-63645bd3be64 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:26.532286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d6934-8b07-48cd-bfa0-c14f3b2efc29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:26.533084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6934-8b07-48cd-bfa0-c14f3b2efc29 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.533412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6934-8b07-48cd-bfa0-c14f3b2efc29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.533768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6934-8b07-48cd-bfa0-c14f3b2efc29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.537171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c58d6934-8b07-48cd-bfa0-c14f3b2efc29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:26.662567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d6934-8b07-48cd-bfa0-c14f3b2efc29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:26.666298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d6934-8b07-48cd-bfa0-c14f3b2efc29 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:26.678149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1018/2051] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:27.823465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:27.941122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193183c-eba9-4c59-8315-12871f10ea35 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:27.941723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193183c-eba9-4c59-8315-12871f10ea35 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:27.942909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193183c-eba9-4c59-8315-12871f10ea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:27.989706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f193183c-eba9-4c59-8315-12871f10ea35 None None] MFA Rules not processed for user `ea1c683cbd9e4f1cae1a833ddd1b980a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:27.991176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f193183c-eba9-4c59-8315-12871f10ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:28.034592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:28.099613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1034/2052] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:28.111415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba506fc-bd18-4261-a944-007716e6679d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:28.111939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba506fc-bd18-4261-a944-007716e6679d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:28.112360 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba506fc-bd18-4261-a944-007716e6679d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:28.151634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2ba506fc-bd18-4261-a944-007716e6679d None None] MFA Rules not processed for user `a35c4f80b4f94c3bbe9643fc6d4d560d`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:28.153231 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2ba506fc-bd18-4261-a944-007716e6679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:28.256330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1019/2053] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:28.262964 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193183c-eba9-4c59-8315-12871f10ea35 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:28.265580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f193183c-eba9-4c59-8315-12871f10ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:28.394567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193183c-eba9-4c59-8315-12871f10ea35 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:28.400104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a84b7-f0ef-468b-8ddb-3f9b3d450ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:28.400720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a84b7-f0ef-468b-8ddb-3f9b3d450ae4 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:28.401001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a84b7-f0ef-468b-8ddb-3f9b3d450ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:28.401277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a84b7-f0ef-468b-8ddb-3f9b3d450ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:28.409153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a84b7-f0ef-468b-8ddb-3f9b3d450ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:28.410806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a84b7-f0ef-468b-8ddb-3f9b3d450ae4 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:28.419980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1035/2054] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:28.462099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba506fc-bd18-4261-a944-007716e6679d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:28.463766 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2ba506fc-bd18-4261-a944-007716e6679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:28.549878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba506fc-bd18-4261-a944-007716e6679d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:28.554675 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387372f-8584-4a35-ba7a-18f4a4be1839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:28.556682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387372f-8584-4a35-ba7a-18f4a4be1839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:28.556682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387372f-8584-4a35-ba7a-18f4a4be1839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:28.556682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387372f-8584-4a35-ba7a-18f4a4be1839 admin admin] PATH_INFO: `/v3/users/c55dbc02c6bc4b459a3491283c5cad48` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:28.557416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387372f-8584-4a35-ba7a-18f4a4be1839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c55dbc02c6bc4b459a3491283c5cad48)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:28.559482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387372f-8584-4a35-ba7a-18f4a4be1839 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:28.906370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8387372f-8584-4a35-ba7a-18f4a4be1839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c55dbc02c6bc4b459a3491283c5cad48'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:29.035206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8387372f-8584-4a35-ba7a-18f4a4be1839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c55dbc02c6bc4b459a3491283c5cad48'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:29.056622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8387372f-8584-4a35-ba7a-18f4a4be1839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c55dbc02c6bc4b459a3491283c5cad48'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:29.056971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8387372f-8584-4a35-ba7a-18f4a4be1839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c55dbc02c6bc4b459a3491283c5cad48'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:29.070630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8387372f-8584-4a35-ba7a-18f4a4be1839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c55dbc02c6bc4b459a3491283c5cad48'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:29.082037 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1020/2055] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:28 2022] DELETE /identity/v3/users/c55dbc02c6bc4b459a3491283c5cad48 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:29.448527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a84b7-f0ef-468b-8ddb-3f9b3d450ae4 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:29.472212 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a84b7-f0ef-468b-8ddb-3f9b3d450ae4 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:29.538857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:29.539740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.540201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.540582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] PATH_INFO: `/v3/projects/aa03db21be08483d94a38d940914e004` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.542178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa03db21be08483d94a38d940914e004)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:29.545011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:29.701740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa03db21be08483d94a38d940914e004', 'request_id': 'req-71047373-af4e-4b03-9433-115457b90722'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:29.789254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:29.821262 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa03db21be08483d94a38d940914e004', 'request_id': 'req-71047373-af4e-4b03-9433-115457b90722'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:29.827698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa03db21be08483d94a38d940914e004', 'request_id': 'req-71047373-af4e-4b03-9433-115457b90722'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:29.839986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] The token cache is being invalidate because project aa03db21be08483d94a38d940914e004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:29.840284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:29.840957 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-71047373-af4e-4b03-9433-115457b90722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:29.842484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1036/2056] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:29 2022] DELETE /identity/v3/projects/aa03db21be08483d94a38d940914e004 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:29.848283 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04135573-a3cf-4727-a7ee-f7b87c04cc74 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.848577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04135573-a3cf-4727-a7ee-f7b87c04cc74 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.848860 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04135573-a3cf-4727-a7ee-f7b87c04cc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.869277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-04135573-a3cf-4727-a7ee-f7b87c04cc74 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:29.870504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-04135573-a3cf-4727-a7ee-f7b87c04cc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:29.931165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1021/2057] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:29.939972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b126-8ebe-4860-9d40-5cb6333d8cb2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.940305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b126-8ebe-4860-9d40-5cb6333d8cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.940585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b126-8ebe-4860-9d40-5cb6333d8cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.960998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f588b126-8ebe-4860-9d40-5cb6333d8cb2 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:29.962230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f588b126-8ebe-4860-9d40-5cb6333d8cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:29.970391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1037/2058] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:29.975322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04135573-a3cf-4727-a7ee-f7b87c04cc74 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:29.985267 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04135573-a3cf-4727-a7ee-f7b87c04cc74 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:29.990741 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3218935-d4b7-47ef-a396-ca95ab71cab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:29.991555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3218935-d4b7-47ef-a396-ca95ab71cab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.991846 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3218935-d4b7-47ef-a396-ca95ab71cab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.992208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3218935-d4b7-47ef-a396-ca95ab71cab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.993116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3218935-d4b7-47ef-a396-ca95ab71cab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:29.993682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3218935-d4b7-47ef-a396-ca95ab71cab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:29.995277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3218935-d4b7-47ef-a396-ca95ab71cab7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:30.008200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1022/2059] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:30.019156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588b126-8ebe-4860-9d40-5cb6333d8cb2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:30.029716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588b126-8ebe-4860-9d40-5cb6333d8cb2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:30.035624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f4eb-b6fc-4269-bfb8-f9217a8b9abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:30.037287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:30.037758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f4eb-b6fc-4269-bfb8-f9217a8b9abb admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:30.038096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f4eb-b6fc-4269-bfb8-f9217a8b9abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:30.038377 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f4eb-b6fc-4269-bfb8-f9217a8b9abb admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:30.039102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845f4eb-b6fc-4269-bfb8-f9217a8b9abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:30.041195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845f4eb-b6fc-4269-bfb8-f9217a8b9abb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:30.168828 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1038/2060] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:30 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:30.173152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3218935-d4b7-47ef-a396-ca95ab71cab7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:30.183297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3218935-d4b7-47ef-a396-ca95ab71cab7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:30.280996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60279cbd-7733-4785-bc9b-758ecd6a6734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:30.281625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60279cbd-7733-4785-bc9b-758ecd6a6734 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:30.281913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60279cbd-7733-4785-bc9b-758ecd6a6734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:30.282192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60279cbd-7733-4785-bc9b-758ecd6a6734 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:30.282840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60279cbd-7733-4785-bc9b-758ecd6a6734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:30.285775 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60279cbd-7733-4785-bc9b-758ecd6a6734 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:30.513098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1023/2061] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:30 2022] POST /identity/v3/users => generated 287 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:30.515642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f4eb-b6fc-4269-bfb8-f9217a8b9abb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:30.529905 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f4eb-b6fc-4269-bfb8-f9217a8b9abb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:30.535299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390315f-bf72-4440-b5c0-9268c7d8e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:30.536064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390315f-bf72-4440-b5c0-9268c7d8e36e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:30.536350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390315f-bf72-4440-b5c0-9268c7d8e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:30.536807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390315f-bf72-4440-b5c0-9268c7d8e36e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:30.537639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390315f-bf72-4440-b5c0-9268c7d8e36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:30.539462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390315f-bf72-4440-b5c0-9268c7d8e36e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:30.551780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1039/2062] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:30.554949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60279cbd-7733-4785-bc9b-758ecd6a6734 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:30.566458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60279cbd-7733-4785-bc9b-758ecd6a6734 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:30.571248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f7edd-a17c-4778-b2c0-aa30509cd82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:30.571862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7edd-a17c-4778-b2c0-aa30509cd82c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:30.572151 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7edd-a17c-4778-b2c0-aa30509cd82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:30.572427 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7edd-a17c-4778-b2c0-aa30509cd82c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:30.573081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f7edd-a17c-4778-b2c0-aa30509cd82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:30.577614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f7edd-a17c-4778-b2c0-aa30509cd82c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:30.593666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1024/2063] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:30.602958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390315f-bf72-4440-b5c0-9268c7d8e36e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:30.611501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390315f-bf72-4440-b5c0-9268c7d8e36e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:30.616552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456437eb-d5de-4652-96a3-7cfa6bd59cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:30.617549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456437eb-d5de-4652-96a3-7cfa6bd59cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:30.618004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456437eb-d5de-4652-96a3-7cfa6bd59cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:30.618286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456437eb-d5de-4652-96a3-7cfa6bd59cdf admin admin] PATH_INFO: `/v3/projects/8b294a51496644218eaa9e9298ce00cc/users/ca07aa8e88294632ae3695b2948b580b/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:30.634139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456437eb-d5de-4652-96a3-7cfa6bd59cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b294a51496644218eaa9e9298ce00cc, user_id=ca07aa8e88294632ae3695b2948b580b, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:30.637052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456437eb-d5de-4652-96a3-7cfa6bd59cdf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:30.760591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1040/2064] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:30 2022] PUT /identity/v3/projects/8b294a51496644218eaa9e9298ce00cc/users/ca07aa8e88294632ae3695b2948b580b/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:30.771379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ee252-a88d-49fe-a6eb-9c1397aa77d8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:30.771663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ee252-a88d-49fe-a6eb-9c1397aa77d8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:30.771965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ee252-a88d-49fe-a6eb-9c1397aa77d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:30.800954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-398ee252-a88d-49fe-a6eb-9c1397aa77d8 None None] MFA Rules not processed for user `ca07aa8e88294632ae3695b2948b580b`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:30.802398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-398ee252-a88d-49fe-a6eb-9c1397aa77d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:30.889868 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1025/2065] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:30.892857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456437eb-d5de-4652-96a3-7cfa6bd59cdf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:30.961654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456437eb-d5de-4652-96a3-7cfa6bd59cdf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:30.967095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb824-df50-4159-b0ab-d0d91ce60295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:30.967722 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb824-df50-4159-b0ab-d0d91ce60295 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:30.968002 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb824-df50-4159-b0ab-d0d91ce60295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:30.968276 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb824-df50-4159-b0ab-d0d91ce60295 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:30.968903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eb824-df50-4159-b0ab-d0d91ce60295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:30.970868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eb824-df50-4159-b0ab-d0d91ce60295 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:31.077098 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1041/2066] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:30 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:31.081727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ee252-a88d-49fe-a6eb-9c1397aa77d8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:31.093501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ee252-a88d-49fe-a6eb-9c1397aa77d8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:31.153186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be492f5-c85e-48f8-885f-4a949d8ed2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:31.154575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be492f5-c85e-48f8-885f-4a949d8ed2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:31.154915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be492f5-c85e-48f8-885f-4a949d8ed2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:31.155223 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be492f5-c85e-48f8-885f-4a949d8ed2b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:31.156248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be492f5-c85e-48f8-885f-4a949d8ed2b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:31.159254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be492f5-c85e-48f8-885f-4a949d8ed2b2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:31.333185 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1026/2067] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:31 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:31.336774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb824-df50-4159-b0ab-d0d91ce60295 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:31.349542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb824-df50-4159-b0ab-d0d91ce60295 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:31.354482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebbdc8-efe5-4dc7-98e0-0b4b24571cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:31.360723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebbdc8-efe5-4dc7-98e0-0b4b24571cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:31.360723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebbdc8-efe5-4dc7-98e0-0b4b24571cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:31.360723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebbdc8-efe5-4dc7-98e0-0b4b24571cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:31.360723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebbdc8-efe5-4dc7-98e0-0b4b24571cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:31.360723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebbdc8-efe5-4dc7-98e0-0b4b24571cd5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:31.373274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1042/2068] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:31.379037 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be492f5-c85e-48f8-885f-4a949d8ed2b2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:31.389860 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be492f5-c85e-48f8-885f-4a949d8ed2b2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:31.394195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0269af6-4259-4d90-ae8a-cfb676ca7424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:31.394861 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0269af6-4259-4d90-ae8a-cfb676ca7424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:31.395645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0269af6-4259-4d90-ae8a-cfb676ca7424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:31.395645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0269af6-4259-4d90-ae8a-cfb676ca7424 admin admin] PATH_INFO: `/v3/projects/408d873d9042478cae27c68028a1fb2f/users/22004916bf4e4ec29e2c742bec9e3e8a/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:31.411430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0269af6-4259-4d90-ae8a-cfb676ca7424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408d873d9042478cae27c68028a1fb2f, user_id=22004916bf4e4ec29e2c742bec9e3e8a, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:31.414133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0269af6-4259-4d90-ae8a-cfb676ca7424 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:31.520657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1027/2069] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:31 2022] PUT /identity/v3/projects/408d873d9042478cae27c68028a1fb2f/users/22004916bf4e4ec29e2c742bec9e3e8a/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:31.524949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebbdc8-efe5-4dc7-98e0-0b4b24571cd5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:31.536466 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebbdc8-efe5-4dc7-98e0-0b4b24571cd5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:31.592428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fafa9-9cbe-4689-8754-db866876df39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:31.592971 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fafa9-9cbe-4689-8754-db866876df39 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:31.593300 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fafa9-9cbe-4689-8754-db866876df39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:31.593536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fafa9-9cbe-4689-8754-db866876df39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:31.594215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fafa9-9cbe-4689-8754-db866876df39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:31.595875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fafa9-9cbe-4689-8754-db866876df39 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:31.605584 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1043/2070] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:31.610092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0269af6-4259-4d90-ae8a-cfb676ca7424 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:31.621777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0269af6-4259-4d90-ae8a-cfb676ca7424 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:31.629292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de71cd2-6f86-4253-9c4c-90acc9435017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:31.629292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de71cd2-6f86-4253-9c4c-90acc9435017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:31.629292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de71cd2-6f86-4253-9c4c-90acc9435017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:31.629292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de71cd2-6f86-4253-9c4c-90acc9435017 admin admin] PATH_INFO: `/v3/projects/408d873d9042478cae27c68028a1fb2f/users/22004916bf4e4ec29e2c742bec9e3e8a/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:31.630549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de71cd2-6f86-4253-9c4c-90acc9435017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408d873d9042478cae27c68028a1fb2f, user_id=22004916bf4e4ec29e2c742bec9e3e8a, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:31.633320 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de71cd2-6f86-4253-9c4c-90acc9435017 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:31.645634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1028/2071] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:31 2022] PUT /identity/v3/projects/408d873d9042478cae27c68028a1fb2f/users/22004916bf4e4ec29e2c742bec9e3e8a/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:31.656011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8132086-2853-47bb-ae21-828bfea48ba4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:31.656302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8132086-2853-47bb-ae21-828bfea48ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:31.656581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8132086-2853-47bb-ae21-828bfea48ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:31.684909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c8132086-2853-47bb-ae21-828bfea48ba4 None None] MFA Rules not processed for user `22004916bf4e4ec29e2c742bec9e3e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:31.686132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c8132086-2853-47bb-ae21-828bfea48ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:31.760184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1044/2072] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:31.772828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de71cd2-6f86-4253-9c4c-90acc9435017 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:31.774586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8de71cd2-6f86-4253-9c4c-90acc9435017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:31.850375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de71cd2-6f86-4253-9c4c-90acc9435017 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:31.855531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526abf0-1d72-41e9-8311-3442db6215af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:31.856989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526abf0-1d72-41e9-8311-3442db6215af service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:31.857443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526abf0-1d72-41e9-8311-3442db6215af service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:31.857889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526abf0-1d72-41e9-8311-3442db6215af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:31.874742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526abf0-1d72-41e9-8311-3442db6215af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:31.876371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526abf0-1d72-41e9-8311-3442db6215af service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:31.886184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1029/2073] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:32.113494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:32.134158 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8132086-2853-47bb-ae21-828bfea48ba4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:32.145036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8132086-2853-47bb-ae21-828bfea48ba4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:32.148703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a70bc-d98b-43e3-a902-200cc8447d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:32.149307 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a70bc-d98b-43e3-a902-200cc8447d99 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:32.149586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a70bc-d98b-43e3-a902-200cc8447d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:32.149862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a70bc-d98b-43e3-a902-200cc8447d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:32.206955 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a70bc-d98b-43e3-a902-200cc8447d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:32.208892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a70bc-d98b-43e3-a902-200cc8447d99 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:32.217940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1045/2074] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:32.328246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526abf0-1d72-41e9-8311-3442db6215af service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:32.329831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5526abf0-1d72-41e9-8311-3442db6215af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:32.401518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526abf0-1d72-41e9-8311-3442db6215af service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:32.407306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:32.407873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:32.408209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:32.408489 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] PATH_INFO: `/v3/users/822cc3674b8446b89a2f2b1bf463a915` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:32.410497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=822cc3674b8446b89a2f2b1bf463a915)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:32.412457 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:32.428748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:32.706183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822cc3674b8446b89a2f2b1bf463a915'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:32.828933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822cc3674b8446b89a2f2b1bf463a915'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:32.858768 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822cc3674b8446b89a2f2b1bf463a915'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:32.859584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822cc3674b8446b89a2f2b1bf463a915'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:32.879131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822cc3674b8446b89a2f2b1bf463a915'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:32.891079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1030/2075] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:32 2022] DELETE /identity/v3/users/822cc3674b8446b89a2f2b1bf463a915 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:32.893894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24d520-ef54-46d5-8e88-2d35efa099d7 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:32.894347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24d520-ef54-46d5-8e88-2d35efa099d7 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:32.894436 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24d520-ef54-46d5-8e88-2d35efa099d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:32.920141 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-cc24d520-ef54-46d5-8e88-2d35efa099d7 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:32.921404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc24d520-ef54-46d5-8e88-2d35efa099d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:32.987648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1046/2076] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:32.997434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:32.998880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:33.057921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310aa0d-d3d9-4ea1-93ce-6f4b59e7fe14 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:33.062189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669f90-b393-48f6-8e65-58170871b9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:33.062799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669f90-b393-48f6-8e65-58170871b9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:33.063249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669f90-b393-48f6-8e65-58170871b9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:33.063686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669f90-b393-48f6-8e65-58170871b9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:33.075148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669f90-b393-48f6-8e65-58170871b9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:33.076619 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669f90-b393-48f6-8e65-58170871b9e2 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:33.086819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1031/2077] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:33.824667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:33.945361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24d520-ef54-46d5-8e88-2d35efa099d7 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:33.948017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc24d520-ef54-46d5-8e88-2d35efa099d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:33.977821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24d520-ef54-46d5-8e88-2d35efa099d7 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:33.983252 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:33.984132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:33.984515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:33.984930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] PATH_INFO: `/v3/projects/9362325e83b746729c51b9737bbaff4a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:33.986268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9362325e83b746729c51b9737bbaff4a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:33.988638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:34.167855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9362325e83b746729c51b9737bbaff4a', 'request_id': 'req-92dca045-7453-4e03-8a2c-a044c3dfd6fe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.249721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:34.257571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9362325e83b746729c51b9737bbaff4a', 'request_id': 'req-92dca045-7453-4e03-8a2c-a044c3dfd6fe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.264757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9362325e83b746729c51b9737bbaff4a', 'request_id': 'req-92dca045-7453-4e03-8a2c-a044c3dfd6fe'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.281681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] The token cache is being invalidate because project 9362325e83b746729c51b9737bbaff4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:34.281681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.281681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.284800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1047/2078] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:33 2022] DELETE /identity/v3/projects/9362325e83b746729c51b9737bbaff4a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:34.296433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669f90-b393-48f6-8e65-58170871b9e2 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:34.307725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669f90-b393-48f6-8e65-58170871b9e2 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:34.369796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:34.370493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:34.370780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:34.371110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] PATH_INFO: `/v3/users/68899382005146acb6a28497c7614158` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:34.375180 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68899382005146acb6a28497c7614158)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:34.375180 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:34.665961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68899382005146acb6a28497c7614158'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.766705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68899382005146acb6a28497c7614158'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.777868 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68899382005146acb6a28497c7614158'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.778615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68899382005146acb6a28497c7614158'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.797845 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68899382005146acb6a28497c7614158'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.813673 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1032/2079] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:34 2022] DELETE /identity/v3/users/68899382005146acb6a28497c7614158 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:35.552151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:35.554103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:35.572354 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca045-7453-4e03-8a2c-a044c3dfd6fe admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:35.645566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:35.646214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:35.646498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:35.646776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] PATH_INFO: `/v3/projects/52bbb822d3014f28b692490d743eac27` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:35.647945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bbb822d3014f28b692490d743eac27)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:35.649869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:35.726244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:35.808816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bbb822d3014f28b692490d743eac27', 'request_id': 'req-a6471537-734c-480d-b87b-48501efd9fe4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:35.873933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bbb822d3014f28b692490d743eac27', 'request_id': 'req-a6471537-734c-480d-b87b-48501efd9fe4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:35.880683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bbb822d3014f28b692490d743eac27', 'request_id': 'req-a6471537-734c-480d-b87b-48501efd9fe4'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:35.892006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] The token cache is being invalidate because project 52bbb822d3014f28b692490d743eac27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:35.892317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:35.893049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:35.894594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1048/2080] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:35 2022] DELETE /identity/v3/projects/52bbb822d3014f28b692490d743eac27 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:35.898976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:35.900587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:35.913081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62d74c-cf9f-4e18-9c14-746f55bdbf35 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:35.953086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:35.970279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:35.971086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:35.971461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:35.971863 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] PATH_INFO: `/v3/users/e93a0596c370494cb9155b0b164e9748` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:35.973138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e93a0596c370494cb9155b0b164e9748)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:35.975364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:36.165813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e93a0596c370494cb9155b0b164e9748'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:36.291293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e93a0596c370494cb9155b0b164e9748'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:36.298891 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e93a0596c370494cb9155b0b164e9748'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:36.300260 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e93a0596c370494cb9155b0b164e9748'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:36.313276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e93a0596c370494cb9155b0b164e9748'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:36.322973 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1033/2081] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:35 2022] DELETE /identity/v3/users/e93a0596c370494cb9155b0b164e9748 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:36.629182 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:36.846891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:36.848403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:36.865954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:36.876599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6471537-734c-480d-b87b-48501efd9fe4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:36.945588 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:36.946243 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:36.946519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:36.946907 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] PATH_INFO: `/v3/projects/8a697903938b4a9c835fd071aaff63b5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:36.948930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a697903938b4a9c835fd071aaff63b5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:36.950873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:37.055746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a697903938b4a9c835fd071aaff63b5', 'request_id': 'req-0f38ca97-4781-412a-8297-2d62097557d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:37.129705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a697903938b4a9c835fd071aaff63b5', 'request_id': 'req-0f38ca97-4781-412a-8297-2d62097557d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:37.136013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a697903938b4a9c835fd071aaff63b5', 'request_id': 'req-0f38ca97-4781-412a-8297-2d62097557d7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:37.148107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] The token cache is being invalidate because project 8a697903938b4a9c835fd071aaff63b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:37.148935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:37.149611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:37.151346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1049/2082] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:36 2022] DELETE /identity/v3/projects/8a697903938b4a9c835fd071aaff63b5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:37.598611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:38.023281 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:38.496989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:39.394731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:39.880101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:40.924792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:41.297421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:42.234450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:43.165654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:43.737046 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:44.312724 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:44.649650 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:45.234341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:45.816862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:46.040147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:46.609680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:47.093912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:47.095391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:47.159697 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:47.167554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763110-d6a6-47d1-805e-4557a70d7e39 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:47.243814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2caf6a-46c5-41d0-bc87-a9e9e9c2a1b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:47.243971 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:47.244733 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2caf6a-46c5-41d0-bc87-a9e9e9c2a1b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:47.245106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2caf6a-46c5-41d0-bc87-a9e9e9c2a1b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:47.245311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2caf6a-46c5-41d0-bc87-a9e9e9c2a1b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:47.247114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8b2caf6a-46c5-41d0-bc87-a9e9e9c2a1b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:47.312498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2caf6a-46c5-41d0-bc87-a9e9e9c2a1b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:47.313953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2caf6a-46c5-41d0-bc87-a9e9e9c2a1b5 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:47.327910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1034/2083] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:47.937054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:48.095580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:48.815110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:48.929769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:49.843147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:50.114347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:50.434445 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:51.085423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:51.709165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:52.375494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:53.090843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:53.542299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:53.646353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:54.387652 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:55.434507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:55.588626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:56.525534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:56.577065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:57.114141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:57.308134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:57.686188 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:57.788688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:58.177184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:58.256860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:58.559980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:58.622336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:58.971125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:59.220746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:00.043671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:00.046097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:00.072341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:00.112738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ca97-4781-412a-8297-2d62097557d7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:00.117425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:00.118099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:00.118386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:00.118666 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] PATH_INFO: `/v3/users/d09444e34ae84874a9bef14b677b6229` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:00.119839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09444e34ae84874a9bef14b677b6229)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:00.121789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:00.362571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09444e34ae84874a9bef14b677b6229'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:00.363254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09444e34ae84874a9bef14b677b6229'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:00.364034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09444e34ae84874a9bef14b677b6229'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:00.462902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09444e34ae84874a9bef14b677b6229'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:00.475679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09444e34ae84874a9bef14b677b6229'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:00.487993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1050/2084] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:00 2022] DELETE /identity/v3/users/d09444e34ae84874a9bef14b677b6229 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:00.505432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126302-3419-4516-9632-0760b9bbfb7d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:00.505942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126302-3419-4516-9632-0760b9bbfb7d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:00.506042 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126302-3419-4516-9632-0760b9bbfb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:00.525094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-11126302-3419-4516-9632-0760b9bbfb7d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:00.526313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-11126302-3419-4516-9632-0760b9bbfb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:00.565881 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:00.588803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1035/2085] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:00.599953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:00.601438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:00.662549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979262-fb18-4111-86df-c0c3efd7f49f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:00.666784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61894199-56f7-4af5-8dcd-04648e0cadc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:00.667667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61894199-56f7-4af5-8dcd-04648e0cadc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:00.667827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61894199-56f7-4af5-8dcd-04648e0cadc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:00.668111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61894199-56f7-4af5-8dcd-04648e0cadc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:00.684862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61894199-56f7-4af5-8dcd-04648e0cadc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:00.686326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61894199-56f7-4af5-8dcd-04648e0cadc3 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:00.697170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1051/2086] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:01.222573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11126302-3419-4516-9632-0760b9bbfb7d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:01.224348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-11126302-3419-4516-9632-0760b9bbfb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:01.241756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11126302-3419-4516-9632-0760b9bbfb7d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:01.246869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:01.247537 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:01.247843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:01.248126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] PATH_INFO: `/v3/projects/417d5a6c94a942a5a8260dfa890a606e` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:01.251537 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=417d5a6c94a942a5a8260dfa890a606e)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:01.251537 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:01.457777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417d5a6c94a942a5a8260dfa890a606e', 'request_id': 'req-527f46b9-151c-44c7-936c-903ba2dad103'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:01.463650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417d5a6c94a942a5a8260dfa890a606e', 'request_id': 'req-527f46b9-151c-44c7-936c-903ba2dad103'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:01.639680 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417d5a6c94a942a5a8260dfa890a606e', 'request_id': 'req-527f46b9-151c-44c7-936c-903ba2dad103'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:01.652139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] The token cache is being invalidate because project 417d5a6c94a942a5a8260dfa890a606e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:01.660439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:01.660439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:01.660439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1036/2087] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:01 2022] DELETE /identity/v3/projects/417d5a6c94a942a5a8260dfa890a606e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:10.692999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=69,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:11.648890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:18.824570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61894199-56f7-4af5-8dcd-04648e0cadc3 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:18.826154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-61894199-56f7-4af5-8dcd-04648e0cadc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:18.840866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61894199-56f7-4af5-8dcd-04648e0cadc3 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:18.900734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:18.901382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:18.901668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:18.901995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] PATH_INFO: `/v3/users/a35c4f80b4f94c3bbe9643fc6d4d560d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:18.903187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35c4f80b4f94c3bbe9643fc6d4d560d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:18.905176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:19.372648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35c4f80b4f94c3bbe9643fc6d4d560d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:19.373237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35c4f80b4f94c3bbe9643fc6d4d560d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:19.373849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35c4f80b4f94c3bbe9643fc6d4d560d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:19.521183 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35c4f80b4f94c3bbe9643fc6d4d560d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:19.535355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35c4f80b4f94c3bbe9643fc6d4d560d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:19.549705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1052/2088] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:18 2022] DELETE /identity/v3/users/a35c4f80b4f94c3bbe9643fc6d4d560d => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:19.982474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:19.984145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:19.997923 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f46b9-151c-44c7-936c-903ba2dad103 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:20.062463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:20.063332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:20.063683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:20.064025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] PATH_INFO: `/v3/projects/38b4211749eb40adafc9fd5bf924d49d` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:20.065221 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b4211749eb40adafc9fd5bf924d49d)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:20.067190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:20.213424 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b4211749eb40adafc9fd5bf924d49d', 'request_id': 'req-10c8c231-f53c-40c6-9f27-f9e616d574a7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:20.222884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b4211749eb40adafc9fd5bf924d49d', 'request_id': 'req-10c8c231-f53c-40c6-9f27-f9e616d574a7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:20.368746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b4211749eb40adafc9fd5bf924d49d', 'request_id': 'req-10c8c231-f53c-40c6-9f27-f9e616d574a7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:20.383237 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] The token cache is being invalidate because project 38b4211749eb40adafc9fd5bf924d49d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:20.383543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:20.384249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-10c8c231-f53c-40c6-9f27-f9e616d574a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:20.389965 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:20.391898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:20.393912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1037/2089] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:19 2022] DELETE /identity/v3/projects/38b4211749eb40adafc9fd5bf924d49d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:20.407200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa7fa3-5478-439f-af70-a17a75c61662 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:20.487439 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:20.488229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:20.488514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:20.488792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] PATH_INFO: `/v3/users/ea1c683cbd9e4f1cae1a833ddd1b980a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:20.490053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1c683cbd9e4f1cae1a833ddd1b980a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:20.492403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:20.515576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:20.751840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1c683cbd9e4f1cae1a833ddd1b980a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:20.751840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1c683cbd9e4f1cae1a833ddd1b980a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:20.762891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1c683cbd9e4f1cae1a833ddd1b980a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:20.868687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1c683cbd9e4f1cae1a833ddd1b980a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:20.883875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1c683cbd9e4f1cae1a833ddd1b980a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:20.904143 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1053/2090] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:20 2022] DELETE /identity/v3/users/ea1c683cbd9e4f1cae1a833ddd1b980a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:21.081334 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afb03-7532-4800-9a6f-434e64849a48 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:21.081867 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afb03-7532-4800-9a6f-434e64849a48 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:21.081867 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afb03-7532-4800-9a6f-434e64849a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:21.102426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4f2afb03-7532-4800-9a6f-434e64849a48 None None] MFA Rules not processed for user `f844fed122764361a93664842d60070e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:21.103972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4f2afb03-7532-4800-9a6f-434e64849a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:21.151272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:21.152858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:21.185508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1038/2091] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:21.229456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ed5a0-5ba5-4421-a028-431a607a4f76 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:21.234476 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:21.238161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:21.238161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:21.238161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] PATH_INFO: `/v3/projects/4eb66b42217945a19674593667eb4d24` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:21.238161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb66b42217945a19674593667eb4d24)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:21.238974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:21.351359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb66b42217945a19674593667eb4d24', 'request_id': 'req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:21.426831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb66b42217945a19674593667eb4d24', 'request_id': 'req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:21.433423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb66b42217945a19674593667eb4d24', 'request_id': 'req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:21.444569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] The token cache is being invalidate because project 4eb66b42217945a19674593667eb4d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:21.444855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:21.445543 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a2121f5a-75b3-4e90-81f1-d8f65e0e4996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:21.447041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1054/2092] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:21 2022] DELETE /identity/v3/projects/4eb66b42217945a19674593667eb4d24 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:21.452116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec529a-f1f6-4be7-b368-fb097ac97d92 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:21.452451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec529a-f1f6-4be7-b368-fb097ac97d92 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:21.452799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec529a-f1f6-4be7-b368-fb097ac97d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:21.474195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c7ec529a-f1f6-4be7-b368-fb097ac97d92 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:21.475439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c7ec529a-f1f6-4be7-b368-fb097ac97d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:21.510200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:21.551570 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1039/2093] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:21.559765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd32c3a-e9b0-4c75-aa88-73b0c465fc6e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:21.560442 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd32c3a-e9b0-4c75-aa88-73b0c465fc6e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:21.561063 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd32c3a-e9b0-4c75-aa88-73b0c465fc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:21.594974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7fd32c3a-e9b0-4c75-aa88-73b0c465fc6e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:21.596857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7fd32c3a-e9b0-4c75-aa88-73b0c465fc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:21.611543 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1055/2094] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:21.616527 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec529a-f1f6-4be7-b368-fb097ac97d92 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:21.627366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec529a-f1f6-4be7-b368-fb097ac97d92 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:21.632924 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a3870-6a98-412a-99ad-729577b1e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:21.633567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a3870-6a98-412a-99ad-729577b1e422 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:21.633852 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a3870-6a98-412a-99ad-729577b1e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:21.634233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a3870-6a98-412a-99ad-729577b1e422 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:21.634782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a3870-6a98-412a-99ad-729577b1e422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:50:21.635254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a3870-6a98-412a-99ad-729577b1e422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:21.636876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a3870-6a98-412a-99ad-729577b1e422 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:21.655006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1040/2095] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:50:21.655990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd32c3a-e9b0-4c75-aa88-73b0c465fc6e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:21.671673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd32c3a-e9b0-4c75-aa88-73b0c465fc6e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:21.678428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93492327-a872-4ec3-b867-f2a157df0c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:21.682769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93492327-a872-4ec3-b867-f2a157df0c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:21.682769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93492327-a872-4ec3-b867-f2a157df0c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:21.682769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93492327-a872-4ec3-b867-f2a157df0c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:21.682769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93492327-a872-4ec3-b867-f2a157df0c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:21.685101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93492327-a872-4ec3-b867-f2a157df0c8e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:21.771795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1056/2096] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:21 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:50:21.773803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a3870-6a98-412a-99ad-729577b1e422 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:21.788305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a3870-6a98-412a-99ad-729577b1e422 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:21.788650 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:21.859141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd14d56-ecb8-46d8-933f-aaefdb48a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:21.859764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd14d56-ecb8-46d8-933f-aaefdb48a9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:21.860059 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd14d56-ecb8-46d8-933f-aaefdb48a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:21.860488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd14d56-ecb8-46d8-933f-aaefdb48a9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:21.861144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd14d56-ecb8-46d8-933f-aaefdb48a9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:21.863135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd14d56-ecb8-46d8-933f-aaefdb48a9c0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:21.948394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1041/2097] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:21 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:50:21.953479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93492327-a872-4ec3-b867-f2a157df0c8e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:21.965539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93492327-a872-4ec3-b867-f2a157df0c8e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:21.971083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db9eba-8255-4c04-af35-7554e16fa4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:21.971719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9eba-8255-4c04-af35-7554e16fa4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:21.972007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9eba-8255-4c04-af35-7554e16fa4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:21.972288 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9eba-8255-4c04-af35-7554e16fa4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:21.972948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db9eba-8255-4c04-af35-7554e16fa4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:21.974579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db9eba-8255-4c04-af35-7554e16fa4d4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:21.985688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1057/2098] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:21.990052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd14d56-ecb8-46d8-933f-aaefdb48a9c0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:22.000831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd14d56-ecb8-46d8-933f-aaefdb48a9c0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:22.007215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc8646-7d48-4c54-b620-ecd34a777d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:22.007835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc8646-7d48-4c54-b620-ecd34a777d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:22.008118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc8646-7d48-4c54-b620-ecd34a777d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:22.008395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc8646-7d48-4c54-b620-ecd34a777d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:22.009082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc8646-7d48-4c54-b620-ecd34a777d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:22.010697 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc8646-7d48-4c54-b620-ecd34a777d43 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:22.029575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1042/2099] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:50:22.033767 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db9eba-8255-4c04-af35-7554e16fa4d4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:22.047551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db9eba-8255-4c04-af35-7554e16fa4d4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:22.052386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091539a4-5312-4e93-bbac-bbb2a2902df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:22.053664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091539a4-5312-4e93-bbac-bbb2a2902df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:22.053993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091539a4-5312-4e93-bbac-bbb2a2902df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:22.054218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091539a4-5312-4e93-bbac-bbb2a2902df0 admin admin] PATH_INFO: `/v3/projects/fef80725913f42d1826c4186c2943f98/users/ba557bdaeae64f62a5fa6d0694ff1447/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:22.087739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091539a4-5312-4e93-bbac-bbb2a2902df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef80725913f42d1826c4186c2943f98, user_id=ba557bdaeae64f62a5fa6d0694ff1447, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:22.093332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091539a4-5312-4e93-bbac-bbb2a2902df0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:22.179691 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1058/2100] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:22 2022] PUT /identity/v3/projects/fef80725913f42d1826c4186c2943f98/users/ba557bdaeae64f62a5fa6d0694ff1447/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:22.190479 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b791f0-4e57-46da-aa23-a9855270eb81 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:22.190976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b791f0-4e57-46da-aa23-a9855270eb81 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:22.190976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b791f0-4e57-46da-aa23-a9855270eb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:22.222947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-12b791f0-4e57-46da-aa23-a9855270eb81 None None] MFA Rules not processed for user `ba557bdaeae64f62a5fa6d0694ff1447`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:22.224944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-12b791f0-4e57-46da-aa23-a9855270eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:22.296789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1043/2101] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:22.309609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091539a4-5312-4e93-bbac-bbb2a2902df0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:22.309609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-091539a4-5312-4e93-bbac-bbb2a2902df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:22.385303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091539a4-5312-4e93-bbac-bbb2a2902df0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:22.389838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d497642-5d3a-4af3-a578-4fe5c808eee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:22.390385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497642-5d3a-4af3-a578-4fe5c808eee0 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:22.390672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497642-5d3a-4af3-a578-4fe5c808eee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:22.390952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497642-5d3a-4af3-a578-4fe5c808eee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:22.399833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d497642-5d3a-4af3-a578-4fe5c808eee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:22.401278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d497642-5d3a-4af3-a578-4fe5c808eee0 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:22.410325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1059/2102] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:22.546579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b791f0-4e57-46da-aa23-a9855270eb81 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:22.549508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-12b791f0-4e57-46da-aa23-a9855270eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:22.617570 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b791f0-4e57-46da-aa23-a9855270eb81 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:22.622391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:22.623032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:22.623344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:22.623628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] PATH_INFO: `/v3/users/ca07aa8e88294632ae3695b2948b580b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:22.624765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca07aa8e88294632ae3695b2948b580b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:22.626807 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:22.894255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca07aa8e88294632ae3695b2948b580b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:23.027582 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca07aa8e88294632ae3695b2948b580b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:23.035996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca07aa8e88294632ae3695b2948b580b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:23.036654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca07aa8e88294632ae3695b2948b580b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:23.048447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca07aa8e88294632ae3695b2948b580b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:23.054312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1044/2103] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:22 2022] DELETE /identity/v3/users/ca07aa8e88294632ae3695b2948b580b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:23.058837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612aa35-0b44-4472-af57-574adfc146f2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:23.059313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612aa35-0b44-4472-af57-574adfc146f2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:23.059402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612aa35-0b44-4472-af57-574adfc146f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:23.077831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1612aa35-0b44-4472-af57-574adfc146f2 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:23.079033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1612aa35-0b44-4472-af57-574adfc146f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:23.137852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1060/2104] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:23.148033 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:23.149456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:23.215490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f66ba-f0f1-4a20-b437-4b5b9186be95 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:23.219399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae05e97-79af-49f7-a1bf-e17f1578f45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:23.220020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae05e97-79af-49f7-a1bf-e17f1578f45a service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:23.220305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae05e97-79af-49f7-a1bf-e17f1578f45a service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:23.223091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae05e97-79af-49f7-a1bf-e17f1578f45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:23.235143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae05e97-79af-49f7-a1bf-e17f1578f45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:23.236834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae05e97-79af-49f7-a1bf-e17f1578f45a service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:23.247841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1045/2105] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:23.283129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:24.070239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612aa35-0b44-4472-af57-574adfc146f2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:24.072083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1612aa35-0b44-4472-af57-574adfc146f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:24.089552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612aa35-0b44-4472-af57-574adfc146f2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:24.098277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:24.099095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:24.099537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:24.099886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] PATH_INFO: `/v3/projects/8b294a51496644218eaa9e9298ce00cc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:24.101513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b294a51496644218eaa9e9298ce00cc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:24.103613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:24.303007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b294a51496644218eaa9e9298ce00cc', 'request_id': 'req-ec3ec8bf-364a-402f-a487-e142d9bb076b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:24.417341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b294a51496644218eaa9e9298ce00cc', 'request_id': 'req-ec3ec8bf-364a-402f-a487-e142d9bb076b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:24.425504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:24.432680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b294a51496644218eaa9e9298ce00cc', 'request_id': 'req-ec3ec8bf-364a-402f-a487-e142d9bb076b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:24.439739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] The token cache is being invalidate because project 8b294a51496644218eaa9e9298ce00cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:24.440039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:24.440698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:24.442520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1061/2106] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:24 2022] DELETE /identity/v3/projects/8b294a51496644218eaa9e9298ce00cc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:24.448258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae05e97-79af-49f7-a1bf-e17f1578f45a service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:24.460318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae05e97-79af-49f7-a1bf-e17f1578f45a service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:24.513536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:24.523318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ea505-7f30-4369-9d70-1f52b861ccf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:24.524118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea505-7f30-4369-9d70-1f52b861ccf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:24.524617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea505-7f30-4369-9d70-1f52b861ccf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:24.524889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea505-7f30-4369-9d70-1f52b861ccf4 admin admin] PATH_INFO: `/v3/users/22004916bf4e4ec29e2c742bec9e3e8a` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:24.526296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ea505-7f30-4369-9d70-1f52b861ccf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22004916bf4e4ec29e2c742bec9e3e8a)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:24.528619 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ea505-7f30-4369-9d70-1f52b861ccf4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:24.789853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ad5ea505-7f30-4369-9d70-1f52b861ccf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22004916bf4e4ec29e2c742bec9e3e8a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:24.887245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ad5ea505-7f30-4369-9d70-1f52b861ccf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22004916bf4e4ec29e2c742bec9e3e8a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:24.896086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ad5ea505-7f30-4369-9d70-1f52b861ccf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22004916bf4e4ec29e2c742bec9e3e8a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:24.896835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ad5ea505-7f30-4369-9d70-1f52b861ccf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22004916bf4e4ec29e2c742bec9e3e8a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:24.911735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ad5ea505-7f30-4369-9d70-1f52b861ccf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22004916bf4e4ec29e2c742bec9e3e8a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:24.918238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1046/2107] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:24 2022] DELETE /identity/v3/users/22004916bf4e4ec29e2c742bec9e3e8a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:25.608000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:25.609604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:25.623031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ec8bf-364a-402f-a487-e142d9bb076b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:25.686456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:25.696961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:25.696961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:25.696961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] PATH_INFO: `/v3/projects/408d873d9042478cae27c68028a1fb2f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:25.696961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=408d873d9042478cae27c68028a1fb2f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:25.696961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:25.833961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408d873d9042478cae27c68028a1fb2f', 'request_id': 'req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:25.951461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408d873d9042478cae27c68028a1fb2f', 'request_id': 'req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:25.959073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408d873d9042478cae27c68028a1fb2f', 'request_id': 'req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:25.971304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] The token cache is being invalidate because project 408d873d9042478cae27c68028a1fb2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:25.971596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:25.972248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-4c71bd1c-f2aa-4304-9d7c-6ec2c43570b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:25.973790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1062/2108] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:25 2022] DELETE /identity/v3/projects/408d873d9042478cae27c68028a1fb2f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:25.978814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dad1a2-df9b-4326-b044-68ffede89319 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:25.979321 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dad1a2-df9b-4326-b044-68ffede89319 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:25.979482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dad1a2-df9b-4326-b044-68ffede89319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:26.000222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f7dad1a2-df9b-4326-b044-68ffede89319 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:26.001521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f7dad1a2-df9b-4326-b044-68ffede89319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:26.062120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1047/2109] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:50:26.070025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff7d20-3513-4911-b00f-397c3bca3e33 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:26.070385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff7d20-3513-4911-b00f-397c3bca3e33 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:26.070688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff7d20-3513-4911-b00f-397c3bca3e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:26.092078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-28ff7d20-3513-4911-b00f-397c3bca3e33 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:26.093396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-28ff7d20-3513-4911-b00f-397c3bca3e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:26.106662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1063/2110] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:26.111378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dad1a2-df9b-4326-b044-68ffede89319 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:26.122991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dad1a2-df9b-4326-b044-68ffede89319 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:26.153573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceec267-f98f-419f-919e-5d5ba69c64c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:26.153573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceec267-f98f-419f-919e-5d5ba69c64c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:26.153573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceec267-f98f-419f-919e-5d5ba69c64c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:26.153573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceec267-f98f-419f-919e-5d5ba69c64c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:26.153850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceec267-f98f-419f-919e-5d5ba69c64c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:50:26.153850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceec267-f98f-419f-919e-5d5ba69c64c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:26.153850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceec267-f98f-419f-919e-5d5ba69c64c9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:26.181393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1048/2111] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:50:26.186003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff7d20-3513-4911-b00f-397c3bca3e33 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:26.205533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff7d20-3513-4911-b00f-397c3bca3e33 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:26.228428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b32b7-d301-4287-8c18-ba4cb163aa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:26.229073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b32b7-d301-4287-8c18-ba4cb163aa48 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:26.233503 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b32b7-d301-4287-8c18-ba4cb163aa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:26.233503 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b32b7-d301-4287-8c18-ba4cb163aa48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:26.233503 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b32b7-d301-4287-8c18-ba4cb163aa48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:26.238830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b32b7-d301-4287-8c18-ba4cb163aa48 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:26.414220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceec267-f98f-419f-919e-5d5ba69c64c9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:26.414617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1064/2112] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:26 2022] POST /identity/v3/projects => generated 363 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:50:26.428169 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceec267-f98f-419f-919e-5d5ba69c64c9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:26.575317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555c497-a654-4674-af83-8244102ed860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:26.577894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c497-a654-4674-af83-8244102ed860 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:26.578535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c497-a654-4674-af83-8244102ed860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:26.580451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c497-a654-4674-af83-8244102ed860 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:26.582097 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555c497-a654-4674-af83-8244102ed860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:26.585412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555c497-a654-4674-af83-8244102ed860 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:26.602491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:26.813761 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1049/2113] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:26 2022] POST /identity/v3/users => generated 282 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:26.816096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b32b7-d301-4287-8c18-ba4cb163aa48 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:26.826396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b32b7-d301-4287-8c18-ba4cb163aa48 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:26.852111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca9130-cab1-4ac6-a86b-b3272416256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:26.852227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50be12-fb85-47c0-9871-3d6f3e60ef68 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:26.852227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50be12-fb85-47c0-9871-3d6f3e60ef68 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:26.852529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9130-cab1-4ac6-a86b-b3272416256c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:26.852529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9130-cab1-4ac6-a86b-b3272416256c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:26.852711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50be12-fb85-47c0-9871-3d6f3e60ef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:26.852793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9130-cab1-4ac6-a86b-b3272416256c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:26.852882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca9130-cab1-4ac6-a86b-b3272416256c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:26.854539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca9130-cab1-4ac6-a86b-b3272416256c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:26.868598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1065/2114] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:26.870409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca9130-cab1-4ac6-a86b-b3272416256c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:26.885370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca9130-cab1-4ac6-a86b-b3272416256c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:26.885703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3a50be12-fb85-47c0-9871-3d6f3e60ef68 None None] MFA Rules not processed for user `7f4db893c9404bf7b97c5b3ac47c9a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:26.886961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3a50be12-fb85-47c0-9871-3d6f3e60ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:26.891137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe6347-9c16-4b88-9bf8-de40adbf5678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:26.891137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe6347-9c16-4b88-9bf8-de40adbf5678 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:26.891455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe6347-9c16-4b88-9bf8-de40adbf5678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:26.891901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe6347-9c16-4b88-9bf8-de40adbf5678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:26.893213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe6347-9c16-4b88-9bf8-de40adbf5678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:26.895328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe6347-9c16-4b88-9bf8-de40adbf5678 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:26.905825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1066/2115] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:26.910551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe6347-9c16-4b88-9bf8-de40adbf5678 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:26.920250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe6347-9c16-4b88-9bf8-de40adbf5678 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:26.925625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa72405-3cf4-4c5b-b4d1-783c69c3d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:26.925831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa72405-3cf4-4c5b-b4d1-783c69c3d957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:26.926118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa72405-3cf4-4c5b-b4d1-783c69c3d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:26.926432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa72405-3cf4-4c5b-b4d1-783c69c3d957 admin admin] PATH_INFO: `/v3/projects/cf8cf068e56840d1a8629a754907253e/users/a3c797359ec64b51895ffb60d7eea9e5/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:26.941267 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa72405-3cf4-4c5b-b4d1-783c69c3d957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8cf068e56840d1a8629a754907253e, user_id=a3c797359ec64b51895ffb60d7eea9e5, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:26.943979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa72405-3cf4-4c5b-b4d1-783c69c3d957 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:26.944836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1050/2116] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:27.049591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1067/2117] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:26 2022] PUT /identity/v3/projects/cf8cf068e56840d1a8629a754907253e/users/a3c797359ec64b51895ffb60d7eea9e5/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:50:27.063735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca842c-0c24-4f58-b1ad-383d964a1522 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:27.064308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca842c-0c24-4f58-b1ad-383d964a1522 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:27.064308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca842c-0c24-4f58-b1ad-383d964a1522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:27.122386 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f0ca842c-0c24-4f58-b1ad-383d964a1522 None None] MFA Rules not processed for user `a3c797359ec64b51895ffb60d7eea9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:27.123595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f0ca842c-0c24-4f58-b1ad-383d964a1522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:27.329486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1051/2118] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:27.334771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa72405-3cf4-4c5b-b4d1-783c69c3d957 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:27.344349 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:27.429162 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa72405-3cf4-4c5b-b4d1-783c69c3d957 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:27.446139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7738a2b-8f21-4f91-ab8f-5391ad2faecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:27.446651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738a2b-8f21-4f91-ab8f-5391ad2faecb admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:27.446934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738a2b-8f21-4f91-ab8f-5391ad2faecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:27.447265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7738a2b-8f21-4f91-ab8f-5391ad2faecb admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:27.447918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7738a2b-8f21-4f91-ab8f-5391ad2faecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:27.451126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7738a2b-8f21-4f91-ab8f-5391ad2faecb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:27.558484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1068/2119] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:27 2022] POST /identity/v3/projects => generated 363 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:27.559587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca842c-0c24-4f58-b1ad-383d964a1522 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:27.575964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca842c-0c24-4f58-b1ad-383d964a1522 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:27.655792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7891798-2eb8-49fc-8181-b66125a8a5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:27.656424 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7891798-2eb8-49fc-8181-b66125a8a5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:27.656707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7891798-2eb8-49fc-8181-b66125a8a5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:27.656984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7891798-2eb8-49fc-8181-b66125a8a5c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:27.657632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7891798-2eb8-49fc-8181-b66125a8a5c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:27.659663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7891798-2eb8-49fc-8181-b66125a8a5c3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:27.837886 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1052/2120] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:27 2022] POST /identity/v3/users => generated 288 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:50:27.844492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7738a2b-8f21-4f91-ab8f-5391ad2faecb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:27.857212 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7738a2b-8f21-4f91-ab8f-5391ad2faecb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:27.862794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954270f7-fdd4-475e-930b-f0d8ef0cde17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:27.863822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954270f7-fdd4-475e-930b-f0d8ef0cde17 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:27.864538 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954270f7-fdd4-475e-930b-f0d8ef0cde17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:27.865904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954270f7-fdd4-475e-930b-f0d8ef0cde17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:27.867228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954270f7-fdd4-475e-930b-f0d8ef0cde17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:27.870177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954270f7-fdd4-475e-930b-f0d8ef0cde17 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:27.886839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1069/2121] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:27.891335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7891798-2eb8-49fc-8181-b66125a8a5c3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:27.920801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7891798-2eb8-49fc-8181-b66125a8a5c3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:27.931672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349b1d5-c6af-4006-aae8-c11555e8ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:27.932751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349b1d5-c6af-4006-aae8-c11555e8ab67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:27.933044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349b1d5-c6af-4006-aae8-c11555e8ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:27.933376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349b1d5-c6af-4006-aae8-c11555e8ab67 admin admin] PATH_INFO: `/v3/projects/2712116c94a64a1b823d4bfb44d71ee9/users/5e1e5afe1d3d41ec9f08e853a95d8637/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:27.989459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:28.007655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349b1d5-c6af-4006-aae8-c11555e8ab67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2712116c94a64a1b823d4bfb44d71ee9, user_id=5e1e5afe1d3d41ec9f08e853a95d8637, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:28.010940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349b1d5-c6af-4006-aae8-c11555e8ab67 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:28.132699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1053/2122] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:27 2022] PUT /identity/v3/projects/2712116c94a64a1b823d4bfb44d71ee9/users/5e1e5afe1d3d41ec9f08e853a95d8637/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:28.136742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954270f7-fdd4-475e-930b-f0d8ef0cde17 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:28.153455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954270f7-fdd4-475e-930b-f0d8ef0cde17 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:28.243678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f568c3-1619-41de-81fe-c459921214b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:28.244402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f568c3-1619-41de-81fe-c459921214b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:28.244743 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f568c3-1619-41de-81fe-c459921214b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:28.248882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f568c3-1619-41de-81fe-c459921214b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:28.248882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f568c3-1619-41de-81fe-c459921214b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:28.248882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f568c3-1619-41de-81fe-c459921214b7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:28.277454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1070/2123] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:28.282170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349b1d5-c6af-4006-aae8-c11555e8ab67 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:28.296735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349b1d5-c6af-4006-aae8-c11555e8ab67 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:28.306469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb25657-76ea-46c2-9c0e-594743aa86bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:28.307780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb25657-76ea-46c2-9c0e-594743aa86bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:28.308141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb25657-76ea-46c2-9c0e-594743aa86bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:28.308553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb25657-76ea-46c2-9c0e-594743aa86bc admin admin] PATH_INFO: `/v3/projects/2712116c94a64a1b823d4bfb44d71ee9/users/5e1e5afe1d3d41ec9f08e853a95d8637/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:28.310748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb25657-76ea-46c2-9c0e-594743aa86bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2712116c94a64a1b823d4bfb44d71ee9, user_id=5e1e5afe1d3d41ec9f08e853a95d8637, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:28.313887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb25657-76ea-46c2-9c0e-594743aa86bc admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:28.332882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1054/2124] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:28 2022] PUT /identity/v3/projects/2712116c94a64a1b823d4bfb44d71ee9/users/5e1e5afe1d3d41ec9f08e853a95d8637/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:50:28.343255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01095d-f303-428e-a794-e6ec7470111a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:28.343580 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01095d-f303-428e-a794-e6ec7470111a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:28.343864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01095d-f303-428e-a794-e6ec7470111a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:28.410933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8f01095d-f303-428e-a794-e6ec7470111a None None] MFA Rules not processed for user `5e1e5afe1d3d41ec9f08e853a95d8637`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:28.412466 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8f01095d-f303-428e-a794-e6ec7470111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:28.572653 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1071/2125] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:28.588328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb25657-76ea-46c2-9c0e-594743aa86bc admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:28.592841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-eeb25657-76ea-46c2-9c0e-594743aa86bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:28.684277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb25657-76ea-46c2-9c0e-594743aa86bc admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:28.689965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b04e5-a752-453d-ac54-5018c79a9f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:28.690927 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b04e5-a752-453d-ac54-5018c79a9f4b service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:28.691828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b04e5-a752-453d-ac54-5018c79a9f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:28.692114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b04e5-a752-453d-ac54-5018c79a9f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:28.708745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b04e5-a752-453d-ac54-5018c79a9f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:28.711985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b04e5-a752-453d-ac54-5018c79a9f4b service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:28.722999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1055/2126] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:29.179541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01095d-f303-428e-a794-e6ec7470111a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:29.181127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8f01095d-f303-428e-a794-e6ec7470111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:29.188326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:29.194466 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01095d-f303-428e-a794-e6ec7470111a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:29.198269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dc59c-742d-40c8-8fde-4e68e07eda81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:29.198880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dc59c-742d-40c8-8fde-4e68e07eda81 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:29.199202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dc59c-742d-40c8-8fde-4e68e07eda81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:29.199477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dc59c-742d-40c8-8fde-4e68e07eda81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:29.257593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dc59c-742d-40c8-8fde-4e68e07eda81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:29.259185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dc59c-742d-40c8-8fde-4e68e07eda81 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:29.268704 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1072/2127] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:30.420149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d659c86-0277-45f9-917b-3844f48abc6c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:30.420683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d659c86-0277-45f9-917b-3844f48abc6c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:30.420683 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d659c86-0277-45f9-917b-3844f48abc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:30.441296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5d659c86-0277-45f9-917b-3844f48abc6c None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:30.442518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5d659c86-0277-45f9-917b-3844f48abc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:30.464043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dc59c-742d-40c8-8fde-4e68e07eda81 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:30.465918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5e9dc59c-742d-40c8-8fde-4e68e07eda81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:30.511193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1056/2128] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:50:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:30.562387 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d659c86-0277-45f9-917b-3844f48abc6c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:30.564170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5d659c86-0277-45f9-917b-3844f48abc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:30.567078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dc59c-742d-40c8-8fde-4e68e07eda81 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:30.571991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:30.572695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:30.572982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:30.573263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] PATH_INFO: `/v3/users/ba557bdaeae64f62a5fa6d0694ff1447` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:30.574592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba557bdaeae64f62a5fa6d0694ff1447)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:30.577328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:30.677842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d659c86-0277-45f9-917b-3844f48abc6c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:30.683416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c47ec9-48bd-46a0-a518-de4b3f4002e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:30.684125 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47ec9-48bd-46a0-a518-de4b3f4002e7 service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:30.684474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47ec9-48bd-46a0-a518-de4b3f4002e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:30.684822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47ec9-48bd-46a0-a518-de4b3f4002e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:30.698011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c47ec9-48bd-46a0-a518-de4b3f4002e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:30.698840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c47ec9-48bd-46a0-a518-de4b3f4002e7 service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:30.709612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1057/2129] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:50:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:30.939721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba557bdaeae64f62a5fa6d0694ff1447'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:30.941397 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba557bdaeae64f62a5fa6d0694ff1447'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:30.942296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba557bdaeae64f62a5fa6d0694ff1447'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:31.027677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba557bdaeae64f62a5fa6d0694ff1447'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:31.049793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba557bdaeae64f62a5fa6d0694ff1447'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:31.077545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1073/2130] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:30 2022] DELETE /identity/v3/users/ba557bdaeae64f62a5fa6d0694ff1447 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:50:31.084697 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bc1a2-44cb-4289-90e2-1c93436f057e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:31.085808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bc1a2-44cb-4289-90e2-1c93436f057e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:31.086392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bc1a2-44cb-4289-90e2-1c93436f057e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:31.120918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-563bc1a2-44cb-4289-90e2-1c93436f057e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:31.122343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-563bc1a2-44cb-4289-90e2-1c93436f057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:31.143083 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:31.232144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1058/2131] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:31.247765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:31.252407 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:31.288570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:31.380910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6490b-879e-49b9-bfeb-18257b46375f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:31.385074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d57161-e3b8-420c-9805-3161f7c2ba3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:31.386102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d57161-e3b8-420c-9805-3161f7c2ba3a service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:31.386617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d57161-e3b8-420c-9805-3161f7c2ba3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:31.387182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d57161-e3b8-420c-9805-3161f7c2ba3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:31.400708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d57161-e3b8-420c-9805-3161f7c2ba3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:31.403753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d57161-e3b8-420c-9805-3161f7c2ba3a service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:31.423257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1074/2132] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:32.795405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bc1a2-44cb-4289-90e2-1c93436f057e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:32.797486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-563bc1a2-44cb-4289-90e2-1c93436f057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:32.815456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bc1a2-44cb-4289-90e2-1c93436f057e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:32.827308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:32.827977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:32.828268 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:32.828526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] PATH_INFO: `/v3/projects/fef80725913f42d1826c4186c2943f98` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:32.836056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef80725913f42d1826c4186c2943f98)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:32.839786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:33.019298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef80725913f42d1826c4186c2943f98', 'request_id': 'req-9026abb2-a14c-4346-bb28-6006947893e6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:33.027757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef80725913f42d1826c4186c2943f98', 'request_id': 'req-9026abb2-a14c-4346-bb28-6006947893e6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:33.125409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef80725913f42d1826c4186c2943f98', 'request_id': 'req-9026abb2-a14c-4346-bb28-6006947893e6'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:33.179458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] The token cache is being invalidate because project fef80725913f42d1826c4186c2943f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:33.184632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:33.184632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9026abb2-a14c-4346-bb28-6006947893e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:33.184632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1059/2133] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:32 2022] DELETE /identity/v3/projects/fef80725913f42d1826c4186c2943f98 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:33.191122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558290-8517-4672-866e-8e9be53de91b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:33.192352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558290-8517-4672-866e-8e9be53de91b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:33.193042 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558290-8517-4672-866e-8e9be53de91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:33.237795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-eb558290-8517-4672-866e-8e9be53de91b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:33.239851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-eb558290-8517-4672-866e-8e9be53de91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:33.326579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1075/2134] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:33.337589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2727b-d1a4-4868-b35e-5f3d6be8e4ac None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:33.338264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2727b-d1a4-4868-b35e-5f3d6be8e4ac None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:33.339160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2727b-d1a4-4868-b35e-5f3d6be8e4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:33.386149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-61a2727b-d1a4-4868-b35e-5f3d6be8e4ac None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:33.387603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-61a2727b-d1a4-4868-b35e-5f3d6be8e4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:33.400018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1060/2135] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:33.405183 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb558290-8517-4672-866e-8e9be53de91b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:33.425444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb558290-8517-4672-866e-8e9be53de91b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:33.442373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd26b8-0b8e-4471-95bd-cfe471a525c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:33.442373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd26b8-0b8e-4471-95bd-cfe471a525c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:33.442373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd26b8-0b8e-4471-95bd-cfe471a525c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:33.442373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd26b8-0b8e-4471-95bd-cfe471a525c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:33.442774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd26b8-0b8e-4471-95bd-cfe471a525c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:50:33.442774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd26b8-0b8e-4471-95bd-cfe471a525c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:33.442774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd26b8-0b8e-4471-95bd-cfe471a525c3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:33.457814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1076/2136] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:50:33.462802 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2727b-d1a4-4868-b35e-5f3d6be8e4ac None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:33.474416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2727b-d1a4-4868-b35e-5f3d6be8e4ac None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:33.480743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c9100-e742-4a6d-a1d6-c9ceb47a81b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:33.481541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c9100-e742-4a6d-a1d6-c9ceb47a81b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:33.481888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c9100-e742-4a6d-a1d6-c9ceb47a81b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:33.482253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c9100-e742-4a6d-a1d6-c9ceb47a81b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:33.482973 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c9100-e742-4a6d-a1d6-c9ceb47a81b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:33.485021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c9100-e742-4a6d-a1d6-c9ceb47a81b9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:33.554571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd26b8-0b8e-4471-95bd-cfe471a525c3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:33.556811 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-52cd26b8-0b8e-4471-95bd-cfe471a525c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:33.598406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd26b8-0b8e-4471-95bd-cfe471a525c3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:33.612129 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a2a43-a030-4b25-9499-e19e5df6a0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:33.616986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a2a43-a030-4b25-9499-e19e5df6a0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:33.616986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a2a43-a030-4b25-9499-e19e5df6a0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:33.616986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a2a43-a030-4b25-9499-e19e5df6a0a6 admin admin] PATH_INFO: `/v3/users/a3c797359ec64b51895ffb60d7eea9e5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:33.618857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a2a43-a030-4b25-9499-e19e5df6a0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c797359ec64b51895ffb60d7eea9e5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:33.622032 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a2a43-a030-4b25-9499-e19e5df6a0a6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:33.626667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1061/2137] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:33 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:33.631908 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c9100-e742-4a6d-a1d6-c9ceb47a81b9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:33.788894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c9100-e742-4a6d-a1d6-c9ceb47a81b9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:33.806789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c7d5c-73b0-48c5-84a2-03d6cd0eb2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:33.807577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c7d5c-73b0-48c5-84a2-03d6cd0eb2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:33.807772 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c7d5c-73b0-48c5-84a2-03d6cd0eb2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:33.807989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c7d5c-73b0-48c5-84a2-03d6cd0eb2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:33.808636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c7d5c-73b0-48c5-84a2-03d6cd0eb2d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:33.810642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c7d5c-73b0-48c5-84a2-03d6cd0eb2d3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:33.923581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c32a2a43-a030-4b25-9499-e19e5df6a0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c797359ec64b51895ffb60d7eea9e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:33.923581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c32a2a43-a030-4b25-9499-e19e5df6a0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c797359ec64b51895ffb60d7eea9e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:33.923581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c32a2a43-a030-4b25-9499-e19e5df6a0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c797359ec64b51895ffb60d7eea9e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:33.941711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:33.956903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1062/2138] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:33 2022] POST /identity/v3/users => generated 287 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:33.962136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c7d5c-73b0-48c5-84a2-03d6cd0eb2d3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:33.967491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-097c7d5c-73b0-48c5-84a2-03d6cd0eb2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:33.999632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c32a2a43-a030-4b25-9499-e19e5df6a0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c797359ec64b51895ffb60d7eea9e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:34.035972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c7d5c-73b0-48c5-84a2-03d6cd0eb2d3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:34.055999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34f248-f89b-4a85-8b71-c53e159f2206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:34.056825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34f248-f89b-4a85-8b71-c53e159f2206 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:34.056825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34f248-f89b-4a85-8b71-c53e159f2206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:34.056994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34f248-f89b-4a85-8b71-c53e159f2206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:34.058635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34f248-f89b-4a85-8b71-c53e159f2206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:34.060056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34f248-f89b-4a85-8b71-c53e159f2206 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:34.060730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c32a2a43-a030-4b25-9499-e19e5df6a0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c797359ec64b51895ffb60d7eea9e5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:34.078349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1063/2139] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:34.084597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34f248-f89b-4a85-8b71-c53e159f2206 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:34.097092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34f248-f89b-4a85-8b71-c53e159f2206 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:34.100432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1077/2140] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:33 2022] DELETE /identity/v3/users/a3c797359ec64b51895ffb60d7eea9e5 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:34.104946 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19080b-d6ae-44fa-9b2d-e1ce50fd5dda None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:34.105585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19080b-d6ae-44fa-9b2d-e1ce50fd5dda None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:34.106119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19080b-d6ae-44fa-9b2d-e1ce50fd5dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:34.172854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0f19080b-d6ae-44fa-9b2d-e1ce50fd5dda None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:34.174120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0f19080b-d6ae-44fa-9b2d-e1ce50fd5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:34.210657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:34.212015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719f9a8-0d2f-48b1-bcd3-94fb5c9a5c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:34.214558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719f9a8-0d2f-48b1-bcd3-94fb5c9a5c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:34.215284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719f9a8-0d2f-48b1-bcd3-94fb5c9a5c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:34.215678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719f9a8-0d2f-48b1-bcd3-94fb5c9a5c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:34.216696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719f9a8-0d2f-48b1-bcd3-94fb5c9a5c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:34.221304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719f9a8-0d2f-48b1-bcd3-94fb5c9a5c82 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:34.266833 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1064/2141] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:34.267899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719f9a8-0d2f-48b1-bcd3-94fb5c9a5c82 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:34.281524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719f9a8-0d2f-48b1-bcd3-94fb5c9a5c82 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:34.292498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272f5d9-c68c-459e-88e2-1218a9ead260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:34.293273 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f5d9-c68c-459e-88e2-1218a9ead260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:34.293692 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f5d9-c68c-459e-88e2-1218a9ead260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:34.294394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f5d9-c68c-459e-88e2-1218a9ead260 admin admin] PATH_INFO: `/v3/projects/6e22fff474964e008839d933c8554cb2/users/d4de7aefd54a4f358569ea52e02cd841/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:34.294526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1078/2142] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:50:34.313073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19080b-d6ae-44fa-9b2d-e1ce50fd5dda None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:34.314749 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0f19080b-d6ae-44fa-9b2d-e1ce50fd5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:34.328678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272f5d9-c68c-459e-88e2-1218a9ead260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e22fff474964e008839d933c8554cb2, user_id=d4de7aefd54a4f358569ea52e02cd841, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:34.340340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272f5d9-c68c-459e-88e2-1218a9ead260 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:34.442022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19080b-d6ae-44fa-9b2d-e1ce50fd5dda None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:34.443793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1065/2143] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:34 2022] PUT /identity/v3/projects/6e22fff474964e008839d933c8554cb2/users/d4de7aefd54a4f358569ea52e02cd841/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:34.455397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ae663-0de5-4e30-8d5b-707fdc26d0ed None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:34.457759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ae663-0de5-4e30-8d5b-707fdc26d0ed None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:34.458502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ae663-0de5-4e30-8d5b-707fdc26d0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:34.534748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57025c-c151-4a14-9f91-473d36f78535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:34.536395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57025c-c151-4a14-9f91-473d36f78535 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:34.536669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57025c-c151-4a14-9f91-473d36f78535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:34.536970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57025c-c151-4a14-9f91-473d36f78535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:34.538868 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3e3ae663-0de5-4e30-8d5b-707fdc26d0ed None None] MFA Rules not processed for user `d4de7aefd54a4f358569ea52e02cd841`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:34.547930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3e3ae663-0de5-4e30-8d5b-707fdc26d0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:34.689818 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57025c-c151-4a14-9f91-473d36f78535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:34.692281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57025c-c151-4a14-9f91-473d36f78535 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:34.708890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1079/2144] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:34.737549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1066/2145] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:34.745775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57025c-c151-4a14-9f91-473d36f78535 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:34.747754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4f57025c-c151-4a14-9f91-473d36f78535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:34.824240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:34.908576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57025c-c151-4a14-9f91-473d36f78535 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:34.936939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d545e42-1092-49f1-9097-6247a2075cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:34.937620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d545e42-1092-49f1-9097-6247a2075cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:34.937830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d545e42-1092-49f1-9097-6247a2075cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:34.938195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d545e42-1092-49f1-9097-6247a2075cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:34.960179 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d545e42-1092-49f1-9097-6247a2075cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:34.961669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d545e42-1092-49f1-9097-6247a2075cb6 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:34.979732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1080/2146] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:36.130293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ae663-0de5-4e30-8d5b-707fdc26d0ed None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:36.131870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3e3ae663-0de5-4e30-8d5b-707fdc26d0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:36.148735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ae663-0de5-4e30-8d5b-707fdc26d0ed None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:36.154079 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:36.154867 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:36.155272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:36.155625 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] PATH_INFO: `/v3/projects/cf8cf068e56840d1a8629a754907253e` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:36.159288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8cf068e56840d1a8629a754907253e)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:36.167846 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:36.326215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:36.340805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8cf068e56840d1a8629a754907253e', 'request_id': 'req-779b3480-4e25-43a4-886b-ed1ab0da526d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:36.348168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8cf068e56840d1a8629a754907253e', 'request_id': 'req-779b3480-4e25-43a4-886b-ed1ab0da526d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:36.420327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8cf068e56840d1a8629a754907253e', 'request_id': 'req-779b3480-4e25-43a4-886b-ed1ab0da526d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:36.446038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] The token cache is being invalidate because project cf8cf068e56840d1a8629a754907253e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:36.446428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:36.447138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:36.452141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1067/2147] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:36 2022] DELETE /identity/v3/projects/cf8cf068e56840d1a8629a754907253e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:36.453455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d545e42-1092-49f1-9097-6247a2075cb6 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:36.478423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d545e42-1092-49f1-9097-6247a2075cb6 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:36.613381 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00682aea-d770-4635-8d14-ba0bbdaf830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:36.613980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00682aea-d770-4635-8d14-ba0bbdaf830d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:36.614271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00682aea-d770-4635-8d14-ba0bbdaf830d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:36.614575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00682aea-d770-4635-8d14-ba0bbdaf830d admin admin] PATH_INFO: `/v3/users/5e1e5afe1d3d41ec9f08e853a95d8637` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:36.617353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00682aea-d770-4635-8d14-ba0bbdaf830d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1e5afe1d3d41ec9f08e853a95d8637)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:36.619360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00682aea-d770-4635-8d14-ba0bbdaf830d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:36.958089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-00682aea-d770-4635-8d14-ba0bbdaf830d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1e5afe1d3d41ec9f08e853a95d8637'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:36.959978 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-00682aea-d770-4635-8d14-ba0bbdaf830d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1e5afe1d3d41ec9f08e853a95d8637'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:36.960884 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-00682aea-d770-4635-8d14-ba0bbdaf830d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1e5afe1d3d41ec9f08e853a95d8637'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:37.034753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-00682aea-d770-4635-8d14-ba0bbdaf830d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1e5afe1d3d41ec9f08e853a95d8637'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:37.072273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-00682aea-d770-4635-8d14-ba0bbdaf830d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1e5afe1d3d41ec9f08e853a95d8637'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:37.087794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1081/2148] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:36 2022] DELETE /identity/v3/users/5e1e5afe1d3d41ec9f08e853a95d8637 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:37.625855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:37.628500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:37.660882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b3480-4e25-43a4-886b-ed1ab0da526d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:37.745966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:37.746520 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:37.746830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:37.747177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] PATH_INFO: `/v3/projects/2712116c94a64a1b823d4bfb44d71ee9` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:37.748400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2712116c94a64a1b823d4bfb44d71ee9)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:37.750534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:37.954456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2712116c94a64a1b823d4bfb44d71ee9', 'request_id': 'req-2014252f-8f7e-494f-9382-03b1f19270df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:37.964681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2712116c94a64a1b823d4bfb44d71ee9', 'request_id': 'req-2014252f-8f7e-494f-9382-03b1f19270df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.091159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2712116c94a64a1b823d4bfb44d71ee9', 'request_id': 'req-2014252f-8f7e-494f-9382-03b1f19270df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.113793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] The token cache is being invalidate because project 2712116c94a64a1b823d4bfb44d71ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:38.114035 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.115428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2014252f-8f7e-494f-9382-03b1f19270df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.124148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1068/2149] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:37 2022] DELETE /identity/v3/projects/2712116c94a64a1b823d4bfb44d71ee9 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:38.126181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2767c-558f-4da8-bf75-26551c834247 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:38.126646 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2767c-558f-4da8-bf75-26551c834247 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:38.127119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2767c-558f-4da8-bf75-26551c834247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:38.184103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-87c2767c-558f-4da8-bf75-26551c834247 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:38.187230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-87c2767c-558f-4da8-bf75-26551c834247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:38.284008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:38.328604 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70df5f-2765-46f9-97e7-ba5c1249ff11 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:38.328978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70df5f-2765-46f9-97e7-ba5c1249ff11 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:38.330047 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70df5f-2765-46f9-97e7-ba5c1249ff11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:38.332566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1082/2150] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:50:38.356383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-cf70df5f-2765-46f9-97e7-ba5c1249ff11 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:38.357822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cf70df5f-2765-46f9-97e7-ba5c1249ff11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:38.372398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2767c-558f-4da8-bf75-26551c834247 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:38.373108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1069/2151] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:38.383603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2767c-558f-4da8-bf75-26551c834247 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:38.388640 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c82cd-7407-4844-883a-e1cf047ee0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:38.389364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c82cd-7407-4844-883a-e1cf047ee0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:38.389714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c82cd-7407-4844-883a-e1cf047ee0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:38.390118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c82cd-7407-4844-883a-e1cf047ee0e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:38.390858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c82cd-7407-4844-883a-e1cf047ee0e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:50:38.391286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c82cd-7407-4844-883a-e1cf047ee0e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:38.393137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c82cd-7407-4844-883a-e1cf047ee0e8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:38.408040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1083/2152] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:50:38.415984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70df5f-2765-46f9-97e7-ba5c1249ff11 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:38.430206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70df5f-2765-46f9-97e7-ba5c1249ff11 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:38.435698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4950-cfec-4308-86af-95cb87cc0f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:38.436415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4950-cfec-4308-86af-95cb87cc0f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:38.436777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4950-cfec-4308-86af-95cb87cc0f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:38.437174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4950-cfec-4308-86af-95cb87cc0f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:38.437978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec4950-cfec-4308-86af-95cb87cc0f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:38.440119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec4950-cfec-4308-86af-95cb87cc0f85 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:38.552667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1070/2153] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:38 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:38.555680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c82cd-7407-4844-883a-e1cf047ee0e8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:38.569231 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c82cd-7407-4844-883a-e1cf047ee0e8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:38.647787 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667e956-1234-4372-894b-314db52224a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:38.648940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667e956-1234-4372-894b-314db52224a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:38.649322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667e956-1234-4372-894b-314db52224a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:38.649890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667e956-1234-4372-894b-314db52224a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:38.650806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667e956-1234-4372-894b-314db52224a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:38.653352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667e956-1234-4372-894b-314db52224a3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:38.797718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1084/2154] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:38 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:38.798412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4950-cfec-4308-86af-95cb87cc0f85 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:38.811813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4950-cfec-4308-86af-95cb87cc0f85 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:38.817499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790bb22-617f-41f3-9f3f-c3f9c2421a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:38.818112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790bb22-617f-41f3-9f3f-c3f9c2421a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:38.818394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790bb22-617f-41f3-9f3f-c3f9c2421a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:38.818669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790bb22-617f-41f3-9f3f-c3f9c2421a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:38.819380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790bb22-617f-41f3-9f3f-c3f9c2421a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:38.821203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790bb22-617f-41f3-9f3f-c3f9c2421a2f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:38.837924 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1071/2155] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:50:38.842187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667e956-1234-4372-894b-314db52224a3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:38.863022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667e956-1234-4372-894b-314db52224a3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:38.885193 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f5448-8668-497a-a75b-00a62a0b95af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:38.888322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5448-8668-497a-a75b-00a62a0b95af admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:38.888900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5448-8668-497a-a75b-00a62a0b95af admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:38.889274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5448-8668-497a-a75b-00a62a0b95af admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:38.890931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f5448-8668-497a-a75b-00a62a0b95af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:38.892621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f5448-8668-497a-a75b-00a62a0b95af admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:38.906284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1085/2156] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:38.910816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790bb22-617f-41f3-9f3f-c3f9c2421a2f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:38.936089 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790bb22-617f-41f3-9f3f-c3f9c2421a2f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:38.941986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e5a66-cb6a-4cd9-a78d-7fb0f95ab938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:38.943135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5a66-cb6a-4cd9-a78d-7fb0f95ab938 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:38.943602 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5a66-cb6a-4cd9-a78d-7fb0f95ab938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:38.944117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5a66-cb6a-4cd9-a78d-7fb0f95ab938 admin admin] PATH_INFO: `/v3/projects/5d0f16b11b88484eb619ec2676b3abc9/users/75cd663dfdc14355983ecbb85db8bccf/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:38.977667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e5a66-cb6a-4cd9-a78d-7fb0f95ab938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0f16b11b88484eb619ec2676b3abc9, user_id=75cd663dfdc14355983ecbb85db8bccf, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:38.982364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e5a66-cb6a-4cd9-a78d-7fb0f95ab938 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:39.108348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:39.115154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1072/2157] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:38 2022] PUT /identity/v3/projects/5d0f16b11b88484eb619ec2676b3abc9/users/75cd663dfdc14355983ecbb85db8bccf/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:50:39.126737 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac389d6f-c2c5-478a-907f-e9ee8d3b41d2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.127305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac389d6f-c2c5-478a-907f-e9ee8d3b41d2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.127305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac389d6f-c2c5-478a-907f-e9ee8d3b41d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.168943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ac389d6f-c2c5-478a-907f-e9ee8d3b41d2 None None] MFA Rules not processed for user `75cd663dfdc14355983ecbb85db8bccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:39.169861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ac389d6f-c2c5-478a-907f-e9ee8d3b41d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:39.273597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1086/2158] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:50:39.278671 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e5a66-cb6a-4cd9-a78d-7fb0f95ab938 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:39.377270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e5a66-cb6a-4cd9-a78d-7fb0f95ab938 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:39.383330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b08b5-2260-4d25-860d-5c5ed4a0298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:39.384131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b08b5-2260-4d25-860d-5c5ed4a0298e admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.384509 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b08b5-2260-4d25-860d-5c5ed4a0298e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.385056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b08b5-2260-4d25-860d-5c5ed4a0298e admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.385975 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b08b5-2260-4d25-860d-5c5ed4a0298e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:39.388315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b08b5-2260-4d25-860d-5c5ed4a0298e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:39.537031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1073/2159] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:39 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:39.537149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac389d6f-c2c5-478a-907f-e9ee8d3b41d2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:39.573162 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac389d6f-c2c5-478a-907f-e9ee8d3b41d2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:39.750044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:39.771954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78652feb-f293-4ea9-a879-35a8a3632d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:39.772673 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78652feb-f293-4ea9-a879-35a8a3632d3d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.772958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78652feb-f293-4ea9-a879-35a8a3632d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.773245 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78652feb-f293-4ea9-a879-35a8a3632d3d admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.773937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78652feb-f293-4ea9-a879-35a8a3632d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:39.776148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78652feb-f293-4ea9-a879-35a8a3632d3d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:40.544950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1087/2160] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:39 2022] POST /identity/v3/users => generated 300 bytes in 1004 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:40.545628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b08b5-2260-4d25-860d-5c5ed4a0298e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:40.555804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b08b5-2260-4d25-860d-5c5ed4a0298e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:40.560793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c92593-ce29-47a4-a984-dc8f4ad5cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:40.561395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c92593-ce29-47a4-a984-dc8f4ad5cd54 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:40.561720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c92593-ce29-47a4-a984-dc8f4ad5cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:40.561999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c92593-ce29-47a4-a984-dc8f4ad5cd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:40.562648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c92593-ce29-47a4-a984-dc8f4ad5cd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:40.564270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c92593-ce29-47a4-a984-dc8f4ad5cd54 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:40.578162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1074/2161] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:40.586534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78652feb-f293-4ea9-a879-35a8a3632d3d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:40.597652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78652feb-f293-4ea9-a879-35a8a3632d3d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:40.613729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1cfc4-091e-4ee2-b095-ac36425f05e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:40.615355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1cfc4-091e-4ee2-b095-ac36425f05e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:40.615655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1cfc4-091e-4ee2-b095-ac36425f05e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:40.615940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1cfc4-091e-4ee2-b095-ac36425f05e0 admin admin] PATH_INFO: `/v3/projects/3d7ce980759240cfa21bd0df5900b91c/users/10b571203cbc4c78b001a0c1843142c5/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:40.638778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1cfc4-091e-4ee2-b095-ac36425f05e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7ce980759240cfa21bd0df5900b91c, user_id=10b571203cbc4c78b001a0c1843142c5, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:40.642222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1cfc4-091e-4ee2-b095-ac36425f05e0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:40.794915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1088/2162] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:40 2022] PUT /identity/v3/projects/3d7ce980759240cfa21bd0df5900b91c/users/10b571203cbc4c78b001a0c1843142c5/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:40.796162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c92593-ce29-47a4-a984-dc8f4ad5cd54 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:40.813804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c92593-ce29-47a4-a984-dc8f4ad5cd54 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:40.930609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d54c4-5d6b-4079-912f-d2dc3836cc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:40.932005 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d54c4-5d6b-4079-912f-d2dc3836cc13 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:40.932299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d54c4-5d6b-4079-912f-d2dc3836cc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:40.932772 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d54c4-5d6b-4079-912f-d2dc3836cc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:40.933912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d54c4-5d6b-4079-912f-d2dc3836cc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:40.941664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d54c4-5d6b-4079-912f-d2dc3836cc13 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:40.962838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1075/2163] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:50:40.968340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1cfc4-091e-4ee2-b095-ac36425f05e0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:40.979624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1cfc4-091e-4ee2-b095-ac36425f05e0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:40.989329 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184889b1-28c9-485d-903b-06ef476efb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:40.991361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184889b1-28c9-485d-903b-06ef476efb71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:40.996847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184889b1-28c9-485d-903b-06ef476efb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:40.996847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184889b1-28c9-485d-903b-06ef476efb71 admin admin] PATH_INFO: `/v3/projects/3d7ce980759240cfa21bd0df5900b91c/users/10b571203cbc4c78b001a0c1843142c5/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:40.996847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184889b1-28c9-485d-903b-06ef476efb71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7ce980759240cfa21bd0df5900b91c, user_id=10b571203cbc4c78b001a0c1843142c5, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:41.000577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184889b1-28c9-485d-903b-06ef476efb71 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:41.015142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1089/2164] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:40 2022] PUT /identity/v3/projects/3d7ce980759240cfa21bd0df5900b91c/users/10b571203cbc4c78b001a0c1843142c5/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:41.027301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1ce76-0e3c-40e4-946b-ff89e48ead94 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:41.027803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1ce76-0e3c-40e4-946b-ff89e48ead94 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:41.028176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1ce76-0e3c-40e4-946b-ff89e48ead94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:41.085203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-55b1ce76-0e3c-40e4-946b-ff89e48ead94 None None] MFA Rules not processed for user `10b571203cbc4c78b001a0c1843142c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:41.085911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-55b1ce76-0e3c-40e4-946b-ff89e48ead94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:41.200144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1076/2165] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:41.212602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184889b1-28c9-485d-903b-06ef476efb71 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:41.214544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-184889b1-28c9-485d-903b-06ef476efb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:41.248251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:41.332676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184889b1-28c9-485d-903b-06ef476efb71 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:41.337499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c895fe-722a-4ab0-9486-022f19dd8bca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:41.338106 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c895fe-722a-4ab0-9486-022f19dd8bca service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:41.338398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c895fe-722a-4ab0-9486-022f19dd8bca service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:41.338732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c895fe-722a-4ab0-9486-022f19dd8bca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:41.351705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c895fe-722a-4ab0-9486-022f19dd8bca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:41.353412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c895fe-722a-4ab0-9486-022f19dd8bca service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:41.368822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1090/2166] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:41.607787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1ce76-0e3c-40e4-946b-ff89e48ead94 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:41.714786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1ce76-0e3c-40e4-946b-ff89e48ead94 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:41.722703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60c1eb-a006-4751-961b-87fbb9c830af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:41.723761 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60c1eb-a006-4751-961b-87fbb9c830af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:41.724236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60c1eb-a006-4751-961b-87fbb9c830af admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:41.724722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60c1eb-a006-4751-961b-87fbb9c830af admin admin] PATH_INFO: `/v3/users/75cd663dfdc14355983ecbb85db8bccf` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:41.726612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60c1eb-a006-4751-961b-87fbb9c830af admin admin] RBAC: Authorizing `identity:delete_user(user_id=75cd663dfdc14355983ecbb85db8bccf)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:41.730352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60c1eb-a006-4751-961b-87fbb9c830af admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:41.859980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c895fe-722a-4ab0-9486-022f19dd8bca service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:41.862670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b9c895fe-722a-4ab0-9486-022f19dd8bca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:41.900236 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c895fe-722a-4ab0-9486-022f19dd8bca service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:41.929582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1617588-8d98-4ac2-8ac3-531d6d078eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:41.930683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1617588-8d98-4ac2-8ac3-531d6d078eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:41.931271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1617588-8d98-4ac2-8ac3-531d6d078eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:41.931886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1617588-8d98-4ac2-8ac3-531d6d078eaf admin admin] PATH_INFO: `/v3/users/d4de7aefd54a4f358569ea52e02cd841` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:41.933539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1617588-8d98-4ac2-8ac3-531d6d078eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4de7aefd54a4f358569ea52e02cd841)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:41.944573 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1617588-8d98-4ac2-8ac3-531d6d078eaf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:42.055758 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7d60c1eb-a006-4751-961b-87fbb9c830af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75cd663dfdc14355983ecbb85db8bccf'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:42.171992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7d60c1eb-a006-4751-961b-87fbb9c830af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75cd663dfdc14355983ecbb85db8bccf'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:42.187782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7d60c1eb-a006-4751-961b-87fbb9c830af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75cd663dfdc14355983ecbb85db8bccf'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:42.189167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7d60c1eb-a006-4751-961b-87fbb9c830af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75cd663dfdc14355983ecbb85db8bccf'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:42.226990 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7d60c1eb-a006-4751-961b-87fbb9c830af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75cd663dfdc14355983ecbb85db8bccf'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:42.250251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1077/2167] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:41 2022] DELETE /identity/v3/users/75cd663dfdc14355983ecbb85db8bccf => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:42.256012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da86bac-4ea4-42dd-8a56-76fff57e5879 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:42.257317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da86bac-4ea4-42dd-8a56-76fff57e5879 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:42.257317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da86bac-4ea4-42dd-8a56-76fff57e5879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:42.280552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1617588-8d98-4ac2-8ac3-531d6d078eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4de7aefd54a4f358569ea52e02cd841'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:42.284126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1617588-8d98-4ac2-8ac3-531d6d078eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4de7aefd54a4f358569ea52e02cd841'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:42.291010 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1617588-8d98-4ac2-8ac3-531d6d078eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4de7aefd54a4f358569ea52e02cd841'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:42.306577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4da86bac-4ea4-42dd-8a56-76fff57e5879 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:42.310077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4da86bac-4ea4-42dd-8a56-76fff57e5879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:42.374053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1617588-8d98-4ac2-8ac3-531d6d078eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4de7aefd54a4f358569ea52e02cd841'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:42.407887 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1617588-8d98-4ac2-8ac3-531d6d078eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4de7aefd54a4f358569ea52e02cd841'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:42.442962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1091/2168] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:41 2022] DELETE /identity/v3/users/d4de7aefd54a4f358569ea52e02cd841 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:42.448470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff39d-bd20-4c99-aaf3-e74373a4bb84 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:42.448470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff39d-bd20-4c99-aaf3-e74373a4bb84 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:42.448757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff39d-bd20-4c99-aaf3-e74373a4bb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:42.480275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1078/2169] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:42.487333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da86bac-4ea4-42dd-8a56-76fff57e5879 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:42.488883 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4da86bac-4ea4-42dd-8a56-76fff57e5879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:42.495087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-74dff39d-bd20-4c99-aaf3-e74373a4bb84 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:42.496287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-74dff39d-bd20-4c99-aaf3-e74373a4bb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:42.518565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:42.527235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:42.622923 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da86bac-4ea4-42dd-8a56-76fff57e5879 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:42.663142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1092/2170] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:42.676125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff39d-bd20-4c99-aaf3-e74373a4bb84 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:42.696411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec88f3a-17f8-43b0-bd78-553ade2af1d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:42.698127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec88f3a-17f8-43b0-bd78-553ade2af1d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:42.698938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec88f3a-17f8-43b0-bd78-553ade2af1d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:42.699420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec88f3a-17f8-43b0-bd78-553ade2af1d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:42.718874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec88f3a-17f8-43b0-bd78-553ade2af1d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:42.720537 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec88f3a-17f8-43b0-bd78-553ade2af1d9 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:42.732793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1079/2171] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:50:42.828753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff39d-bd20-4c99-aaf3-e74373a4bb84 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:42.846839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d20b1c-6d97-4adf-8e8b-0e6a3922a2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:42.848536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20b1c-6d97-4adf-8e8b-0e6a3922a2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:42.848921 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20b1c-6d97-4adf-8e8b-0e6a3922a2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:42.849207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d20b1c-6d97-4adf-8e8b-0e6a3922a2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:42.881575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d20b1c-6d97-4adf-8e8b-0e6a3922a2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:42.883073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d20b1c-6d97-4adf-8e8b-0e6a3922a2c5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:42.900029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1093/2172] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:50:43.590558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec88f3a-17f8-43b0-bd78-553ade2af1d9 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:43.590558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2ec88f3a-17f8-43b0-bd78-553ade2af1d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:43.609697 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec88f3a-17f8-43b0-bd78-553ade2af1d9 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:43.627208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:43.629104 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:43.629579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:43.630166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] PATH_INFO: `/v3/projects/5d0f16b11b88484eb619ec2676b3abc9` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:43.633884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d0f16b11b88484eb619ec2676b3abc9)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:43.636158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:43.861633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d20b1c-6d97-4adf-8e8b-0e6a3922a2c5 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:43.874206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f6d20b1c-6d97-4adf-8e8b-0e6a3922a2c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:43.892699 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d0f16b11b88484eb619ec2676b3abc9', 'request_id': 'req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:43.906403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d20b1c-6d97-4adf-8e8b-0e6a3922a2c5 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:43.909242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d0f16b11b88484eb619ec2676b3abc9', 'request_id': 'req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:43.997171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:43.998113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:43.998403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:43.998679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] PATH_INFO: `/v3/projects/6e22fff474964e008839d933c8554cb2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:43.999851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e22fff474964e008839d933c8554cb2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:44.001954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:44.113053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d0f16b11b88484eb619ec2676b3abc9', 'request_id': 'req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.126506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] The token cache is being invalidate because project 5d0f16b11b88484eb619ec2676b3abc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:44.127101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.127819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.129543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1080/2173] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:43 2022] DELETE /identity/v3/projects/5d0f16b11b88484eb619ec2676b3abc9 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:44.133455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:44.135106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:44.150080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc9382-fe02-4cc7-b577-9dbbeaf299b1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:44.155077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:44.155781 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:44.156066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:44.156398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] PATH_INFO: `/v3/users/10b571203cbc4c78b001a0c1843142c5` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:44.157559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b571203cbc4c78b001a0c1843142c5)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:44.160478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:44.188795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e22fff474964e008839d933c8554cb2', 'request_id': 'req-86ee287b-6579-48bb-9f43-87ae4c305498'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.339679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e22fff474964e008839d933c8554cb2', 'request_id': 'req-86ee287b-6579-48bb-9f43-87ae4c305498'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.342868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:44.349137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e22fff474964e008839d933c8554cb2', 'request_id': 'req-86ee287b-6579-48bb-9f43-87ae4c305498'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.364770 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] The token cache is being invalidate because project 6e22fff474964e008839d933c8554cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:44.365418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.366223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-86ee287b-6579-48bb-9f43-87ae4c305498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.368343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1094/2174] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:43 2022] DELETE /identity/v3/projects/6e22fff474964e008839d933c8554cb2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:44.373619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd422e58-d50e-45f3-9d40-a4e0103307e6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:44.374269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd422e58-d50e-45f3-9d40-a4e0103307e6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:44.374731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd422e58-d50e-45f3-9d40-a4e0103307e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:44.405427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dd422e58-d50e-45f3-9d40-a4e0103307e6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:44.410858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dd422e58-d50e-45f3-9d40-a4e0103307e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:44.480925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1095/2175] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:44.490662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab7578-9b37-4e9d-87c7-24285b30aecc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:44.493385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab7578-9b37-4e9d-87c7-24285b30aecc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:44.493385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab7578-9b37-4e9d-87c7-24285b30aecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:44.501954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b571203cbc4c78b001a0c1843142c5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.506126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:44.525536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bcab7578-9b37-4e9d-87c7-24285b30aecc None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:44.539344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bcab7578-9b37-4e9d-87c7-24285b30aecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:44.539344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1096/2176] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:44.541205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab7578-9b37-4e9d-87c7-24285b30aecc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:44.551275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab7578-9b37-4e9d-87c7-24285b30aecc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:44.565371 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe476eea-6258-4c82-91c3-4df667cf3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:44.566148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe476eea-6258-4c82-91c3-4df667cf3d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:44.566531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe476eea-6258-4c82-91c3-4df667cf3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:44.566908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe476eea-6258-4c82-91c3-4df667cf3d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:44.567736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe476eea-6258-4c82-91c3-4df667cf3d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:50:44.568925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe476eea-6258-4c82-91c3-4df667cf3d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:44.570374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe476eea-6258-4c82-91c3-4df667cf3d0c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:44.587798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1097/2177] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:50:44.590657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe476eea-6258-4c82-91c3-4df667cf3d0c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:44.602025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe476eea-6258-4c82-91c3-4df667cf3d0c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:44.628455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca3337-63d5-4cef-987a-8b8e14e30319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:44.628455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca3337-63d5-4cef-987a-8b8e14e30319 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:44.628455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca3337-63d5-4cef-987a-8b8e14e30319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:44.628455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca3337-63d5-4cef-987a-8b8e14e30319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:44.628949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca3337-63d5-4cef-987a-8b8e14e30319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:44.628949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca3337-63d5-4cef-987a-8b8e14e30319 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:44.650135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b571203cbc4c78b001a0c1843142c5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.662318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b571203cbc4c78b001a0c1843142c5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.662318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b571203cbc4c78b001a0c1843142c5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.680875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b571203cbc4c78b001a0c1843142c5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:44.688181 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1081/2178] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:44 2022] DELETE /identity/v3/users/10b571203cbc4c78b001a0c1843142c5 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:44.809135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1098/2179] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:44 2022] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:44.813880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:44.815765 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:44.898504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e84d36-20ec-4751-b7ef-7502b754ff49 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:44.959649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d1ae-7ca3-4a18-987d-9a76fc8f42f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:44.960273 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d1ae-7ca3-4a18-987d-9a76fc8f42f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:44.960558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d1ae-7ca3-4a18-987d-9a76fc8f42f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:44.960834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d1ae-7ca3-4a18-987d-9a76fc8f42f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:44.961466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723d1ae-7ca3-4a18-987d-9a76fc8f42f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:44.963529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723d1ae-7ca3-4a18-987d-9a76fc8f42f6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:45.458605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1082/2180] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:44 2022] POST /identity/v3/users => generated 287 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:45.463016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca3337-63d5-4cef-987a-8b8e14e30319 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:45.474391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca3337-63d5-4cef-987a-8b8e14e30319 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:45.479950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5374dca-2147-4fa7-8810-4203997408f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:45.480688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5374dca-2147-4fa7-8810-4203997408f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:45.481188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5374dca-2147-4fa7-8810-4203997408f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:45.481539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5374dca-2147-4fa7-8810-4203997408f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:45.482325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5374dca-2147-4fa7-8810-4203997408f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:45.484633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5374dca-2147-4fa7-8810-4203997408f2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:45.498158 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1099/2181] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:45.502164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d1ae-7ca3-4a18-987d-9a76fc8f42f6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:45.517557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d1ae-7ca3-4a18-987d-9a76fc8f42f6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:45.523080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ecbd3-717a-498c-b1c7-d8173b15b5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:45.524029 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ecbd3-717a-498c-b1c7-d8173b15b5bd admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:45.524456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ecbd3-717a-498c-b1c7-d8173b15b5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:45.524961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ecbd3-717a-498c-b1c7-d8173b15b5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:45.525830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ecbd3-717a-498c-b1c7-d8173b15b5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:45.527609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ecbd3-717a-498c-b1c7-d8173b15b5bd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:45.550975 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1083/2182] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:45.551372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5374dca-2147-4fa7-8810-4203997408f2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:45.558250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5374dca-2147-4fa7-8810-4203997408f2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:45.564118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1825fd1-0430-40fb-b1cd-2d39e03e1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:45.565134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1825fd1-0430-40fb-b1cd-2d39e03e1b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:45.565595 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1825fd1-0430-40fb-b1cd-2d39e03e1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:45.566036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1825fd1-0430-40fb-b1cd-2d39e03e1b5f admin admin] PATH_INFO: `/v3/projects/3dee3060a262499a93d3075c82b0781b/users/75fe5a8612874ee0bae31d0d6a713bf7/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:45.613811 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1825fd1-0430-40fb-b1cd-2d39e03e1b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dee3060a262499a93d3075c82b0781b, user_id=75fe5a8612874ee0bae31d0d6a713bf7, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:45.618235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1825fd1-0430-40fb-b1cd-2d39e03e1b5f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:45.738305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1100/2183] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:45 2022] PUT /identity/v3/projects/3dee3060a262499a93d3075c82b0781b/users/75fe5a8612874ee0bae31d0d6a713bf7/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:45.750533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70cd07-a4e9-47ac-8982-2e9250aaed68 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:45.752033 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70cd07-a4e9-47ac-8982-2e9250aaed68 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:45.752831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70cd07-a4e9-47ac-8982-2e9250aaed68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:45.785230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-db70cd07-a4e9-47ac-8982-2e9250aaed68 None None] MFA Rules not processed for user `75fe5a8612874ee0bae31d0d6a713bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:45.786825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-db70cd07-a4e9-47ac-8982-2e9250aaed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:45.813384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1825fd1-0430-40fb-b1cd-2d39e03e1b5f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:45.816992 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f1825fd1-0430-40fb-b1cd-2d39e03e1b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:45.875420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:45.904877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1084/2184] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:45.916123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70cd07-a4e9-47ac-8982-2e9250aaed68 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:45.918454 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-db70cd07-a4e9-47ac-8982-2e9250aaed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:45.962364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1825fd1-0430-40fb-b1cd-2d39e03e1b5f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:45.973687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:45.975430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:45.975716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:45.975993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] PATH_INFO: `/v3/projects/3d7ce980759240cfa21bd0df5900b91c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:45.980711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7ce980759240cfa21bd0df5900b91c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:45.986049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:46.023058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:46.059597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70cd07-a4e9-47ac-8982-2e9250aaed68 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:46.069528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebf3da-03c1-402c-a58f-7c244aa93110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:46.070650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf3da-03c1-402c-a58f-7c244aa93110 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:46.071250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf3da-03c1-402c-a58f-7c244aa93110 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:46.071987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf3da-03c1-402c-a58f-7c244aa93110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:46.096709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebf3da-03c1-402c-a58f-7c244aa93110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:46.098400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebf3da-03c1-402c-a58f-7c244aa93110 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:46.126616 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1085/2185] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:50:46.207773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7ce980759240cfa21bd0df5900b91c', 'request_id': 'req-75328506-a9cd-42e2-a8a7-2ed2514bc464'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:46.351033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7ce980759240cfa21bd0df5900b91c', 'request_id': 'req-75328506-a9cd-42e2-a8a7-2ed2514bc464'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:46.358471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7ce980759240cfa21bd0df5900b91c', 'request_id': 'req-75328506-a9cd-42e2-a8a7-2ed2514bc464'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:46.375375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] The token cache is being invalidate because project 3d7ce980759240cfa21bd0df5900b91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:46.376081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:46.377104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-75328506-a9cd-42e2-a8a7-2ed2514bc464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:46.379560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1101/2186] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:45 2022] DELETE /identity/v3/projects/3d7ce980759240cfa21bd0df5900b91c => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:46.384639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20883b4e-c49f-4d4a-86c6-cb4fc92b6390 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:46.385145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20883b4e-c49f-4d4a-86c6-cb4fc92b6390 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:46.385425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20883b4e-c49f-4d4a-86c6-cb4fc92b6390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:46.406716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-20883b4e-c49f-4d4a-86c6-cb4fc92b6390 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:46.407974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-20883b4e-c49f-4d4a-86c6-cb4fc92b6390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:46.477666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1086/2187] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:46.486018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03737e-32ae-467a-8dac-48218bb90873 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:46.486599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03737e-32ae-467a-8dac-48218bb90873 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:46.486599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03737e-32ae-467a-8dac-48218bb90873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:46.508495 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ec03737e-32ae-467a-8dac-48218bb90873 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:46.509750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ec03737e-32ae-467a-8dac-48218bb90873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:46.517827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1102/2188] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:46.527628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20883b4e-c49f-4d4a-86c6-cb4fc92b6390 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:46.538054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20883b4e-c49f-4d4a-86c6-cb4fc92b6390 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:46.542662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38547a0-ab61-4cfc-b670-ce27a45dc6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:46.543305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38547a0-ab61-4cfc-b670-ce27a45dc6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:46.543589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38547a0-ab61-4cfc-b670-ce27a45dc6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:46.543866 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38547a0-ab61-4cfc-b670-ce27a45dc6cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:46.544518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38547a0-ab61-4cfc-b670-ce27a45dc6cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:50:46.544829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38547a0-ab61-4cfc-b670-ce27a45dc6cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:46.546716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38547a0-ab61-4cfc-b670-ce27a45dc6cd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:46.560326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1087/2189] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:50:46.564686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03737e-32ae-467a-8dac-48218bb90873 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:46.573678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03737e-32ae-467a-8dac-48218bb90873 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:46.578369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28679b-38ab-43e8-a4db-c5b4ff3a8f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:46.578958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28679b-38ab-43e8-a4db-c5b4ff3a8f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:46.579266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28679b-38ab-43e8-a4db-c5b4ff3a8f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:46.579539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28679b-38ab-43e8-a4db-c5b4ff3a8f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:46.580274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28679b-38ab-43e8-a4db-c5b4ff3a8f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:46.582994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28679b-38ab-43e8-a4db-c5b4ff3a8f24 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:46.802374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1103/2190] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:46 2022] POST /identity/v3/projects => generated 373 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:46.806577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38547a0-ab61-4cfc-b670-ce27a45dc6cd admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:46.817510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38547a0-ab61-4cfc-b670-ce27a45dc6cd admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:46.885030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef174e-2c45-4b31-8baa-bdfec12cc281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:46.885675 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef174e-2c45-4b31-8baa-bdfec12cc281 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:46.885956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef174e-2c45-4b31-8baa-bdfec12cc281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:46.886232 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef174e-2c45-4b31-8baa-bdfec12cc281 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:46.886875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef174e-2c45-4b31-8baa-bdfec12cc281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:46.888925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef174e-2c45-4b31-8baa-bdfec12cc281 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:47.051688 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1088/2191] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:46 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:47.056429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28679b-38ab-43e8-a4db-c5b4ff3a8f24 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:47.067500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28679b-38ab-43e8-a4db-c5b4ff3a8f24 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:47.072859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5fa8-e567-4f9c-814d-3095b41bccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:47.073486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5fa8-e567-4f9c-814d-3095b41bccdb admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:47.073768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5fa8-e567-4f9c-814d-3095b41bccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:47.074044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5fa8-e567-4f9c-814d-3095b41bccdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:47.074707 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f5fa8-e567-4f9c-814d-3095b41bccdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:47.076412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f5fa8-e567-4f9c-814d-3095b41bccdb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:47.088408 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1104/2192] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:50:47.097193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef174e-2c45-4b31-8baa-bdfec12cc281 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:47.102541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:47.108038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef174e-2c45-4b31-8baa-bdfec12cc281 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:47.112548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b40b8b-e5ae-49b8-a897-b4d1691f4f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:47.113143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40b8b-e5ae-49b8-a897-b4d1691f4f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:47.113420 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40b8b-e5ae-49b8-a897-b4d1691f4f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:47.113694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40b8b-e5ae-49b8-a897-b4d1691f4f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:47.114335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b40b8b-e5ae-49b8-a897-b4d1691f4f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:47.115964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b40b8b-e5ae-49b8-a897-b4d1691f4f96 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:47.127438 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1089/2193] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:47.131824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5fa8-e567-4f9c-814d-3095b41bccdb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:47.145855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5fa8-e567-4f9c-814d-3095b41bccdb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:47.152415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f70a-ac8e-4128-952b-76a06ffd55de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:47.153138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f70a-ac8e-4128-952b-76a06ffd55de admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:47.153443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f70a-ac8e-4128-952b-76a06ffd55de admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:47.153783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f70a-ac8e-4128-952b-76a06ffd55de admin admin] PATH_INFO: `/v3/projects/5f8ef06f64cc46598cc4f34e4a40e809/users/f7752cb1cf5d44b68ae08cfd5018d1be/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:47.195474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6f70a-ac8e-4128-952b-76a06ffd55de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8ef06f64cc46598cc4f34e4a40e809, user_id=f7752cb1cf5d44b68ae08cfd5018d1be, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:47.198274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6f70a-ac8e-4128-952b-76a06ffd55de admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:47.302107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1105/2194] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:47 2022] PUT /identity/v3/projects/5f8ef06f64cc46598cc4f34e4a40e809/users/f7752cb1cf5d44b68ae08cfd5018d1be/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:47.307402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3a4a3-223c-4b2e-813d-27e987b5e4ce None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:47.307698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3a4a3-223c-4b2e-813d-27e987b5e4ce None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:47.308088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3a4a3-223c-4b2e-813d-27e987b5e4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:47.337644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d0f3a4a3-223c-4b2e-813d-27e987b5e4ce None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:47.338986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d0f3a4a3-223c-4b2e-813d-27e987b5e4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:47.417994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1090/2195] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:50:47.433570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f70a-ac8e-4128-952b-76a06ffd55de admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:47.435494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-32c6f70a-ac8e-4128-952b-76a06ffd55de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:47.498176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f70a-ac8e-4128-952b-76a06ffd55de admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:47.502747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528a0cf-3fae-41df-aa80-629f1b43c821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:47.503574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528a0cf-3fae-41df-aa80-629f1b43c821 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:47.503856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528a0cf-3fae-41df-aa80-629f1b43c821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:47.504135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528a0cf-3fae-41df-aa80-629f1b43c821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:47.514181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528a0cf-3fae-41df-aa80-629f1b43c821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:47.515713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528a0cf-3fae-41df-aa80-629f1b43c821 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:47.525982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1106/2196] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:48.299165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edad9f-86a4-4772-8d25-9f28f31a293f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:48.300072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edad9f-86a4-4772-8d25-9f28f31a293f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:48.300416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edad9f-86a4-4772-8d25-9f28f31a293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:48.320991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-73edad9f-86a4-4772-8d25-9f28f31a293f None None] MFA Rules not processed for user `75fe5a8612874ee0bae31d0d6a713bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:48.322203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-73edad9f-86a4-4772-8d25-9f28f31a293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:48.380380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1091/2197] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:48.983920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea0966-209b-42c1-ad5b-09faa704dfc3 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:48.984752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea0966-209b-42c1-ad5b-09faa704dfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:48.985224 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea0966-209b-42c1-ad5b-09faa704dfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:49.023464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b9ea0966-209b-42c1-ad5b-09faa704dfc3 None None] MFA Rules not processed for user `f7752cb1cf5d44b68ae08cfd5018d1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:49.024699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b9ea0966-209b-42c1-ad5b-09faa704dfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:49.062130 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:49.125667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1107/2198] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:49.133711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edad9f-86a4-4772-8d25-9f28f31a293f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:49.135372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-73edad9f-86a4-4772-8d25-9f28f31a293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:49.211664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edad9f-86a4-4772-8d25-9f28f31a293f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:49.214896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1252d-472e-4764-bd97-dece40c0ce20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:49.215538 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1252d-472e-4764-bd97-dece40c0ce20 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:49.215820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1252d-472e-4764-bd97-dece40c0ce20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:49.216128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1252d-472e-4764-bd97-dece40c0ce20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:49.227735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1252d-472e-4764-bd97-dece40c0ce20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:49.229271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1252d-472e-4764-bd97-dece40c0ce20 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:49.240832 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1092/2199] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:50:52.274860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34fedb-8ae7-4d51-882a-ac39216e5353 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:52.275528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34fedb-8ae7-4d51-882a-ac39216e5353 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:52.275528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34fedb-8ae7-4d51-882a-ac39216e5353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:52.297921 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ed34fedb-8ae7-4d51-882a-ac39216e5353 None None] MFA Rules not processed for user `f7752cb1cf5d44b68ae08cfd5018d1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:52.300962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ed34fedb-8ae7-4d51-882a-ac39216e5353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:52.308979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1108/2200] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:50:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:55.684898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9098e-78f1-4043-abf8-7f40c087bab8 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:55.685360 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9098e-78f1-4043-abf8-7f40c087bab8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:55.686194 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9098e-78f1-4043-abf8-7f40c087bab8 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:55.688123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1093/2201] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:50:55.694214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea992860-ce3f-40e3-aef5-de811094e154 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:55.695026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea992860-ce3f-40e3-aef5-de811094e154 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:55.695334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea992860-ce3f-40e3-aef5-de811094e154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:55.727527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ea992860-ce3f-40e3-aef5-de811094e154 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:55.728763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ea992860-ce3f-40e3-aef5-de811094e154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:55.802689 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1109/2202] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:50:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:55.815775 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9098e-78f1-4043-abf8-7f40c087bab8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:55.817456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-55e9098e-78f1-4043-abf8-7f40c087bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:55.868454 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:55.880284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9098e-78f1-4043-abf8-7f40c087bab8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:55.883958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e98a6-ba30-4d88-bd76-3e5539021c9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6955fc5b81a040f686e21621ea968a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:55.884571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e98a6-ba30-4d88-bd76-3e5539021c9b service glance] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:55.884850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e98a6-ba30-4d88-bd76-3e5539021c9b service glance] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:55.885131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e98a6-ba30-4d88-bd76-3e5539021c9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:55.896354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e98a6-ba30-4d88-bd76-3e5539021c9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:55.898082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e98a6-ba30-4d88-bd76-3e5539021c9b service glance] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:55.909507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1094/2203] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:56.132502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d5c1-7a71-488e-b18f-91ebc4d009f5 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:56.132896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d5c1-7a71-488e-b18f-91ebc4d009f5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:56.133253 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d5c1-7a71-488e-b18f-91ebc4d009f5 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:56.135038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1110/2204] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:50:56.143898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7079a-6e64-41b1-8054-302aa067b55e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:56.144784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7079a-6e64-41b1-8054-302aa067b55e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:56.145251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7079a-6e64-41b1-8054-302aa067b55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:56.175712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-dea7079a-6e64-41b1-8054-302aa067b55e None None] MFA Rules not processed for user `b4ab7a3b191e4a0b84b396cafa8a9ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:56.178162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dea7079a-6e64-41b1-8054-302aa067b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:56.195843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1095/2205] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:50:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:50:56.205948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1d5c1-7a71-488e-b18f-91ebc4d009f5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:56.208654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-48f1d5c1-7a71-488e-b18f-91ebc4d009f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:56.224170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1d5c1-7a71-488e-b18f-91ebc4d009f5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:56.228214 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3c49-3e3b-4738-ba2f-32ecff21a5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:56.230201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3c49-3e3b-4738-ba2f-32ecff21a5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:56.230549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3c49-3e3b-4738-ba2f-32ecff21a5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:56.230954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3c49-3e3b-4738-ba2f-32ecff21a5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:56.241333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f3c49-3e3b-4738-ba2f-32ecff21a5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:56.242974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f3c49-3e3b-4738-ba2f-32ecff21a5a6 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:56.252922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1111/2206] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:56.369763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd600-5063-48b0-8777-488aa24bb7f1 None None] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:56.370093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd600-5063-48b0-8777-488aa24bb7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:56.370425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd600-5063-48b0-8777-488aa24bb7f1 None None] PATH_INFO: `/` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:56.372030 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1096/2207] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:50:56.380688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8a0c7-2f1f-4041-a620-fcc2b8f48e79 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:56.381279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8a0c7-2f1f-4041-a620-fcc2b8f48e79 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:56.382136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8a0c7-2f1f-4041-a620-fcc2b8f48e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:56.403091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-78d8a0c7-2f1f-4041-a620-fcc2b8f48e79 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:56.404794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-78d8a0c7-2f1f-4041-a620-fcc2b8f48e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:56.416631 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1112/2208] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:50:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:56.432196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dd600-5063-48b0-8777-488aa24bb7f1 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:56.443755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dd600-5063-48b0-8777-488aa24bb7f1 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:56.447397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45929f03-cb69-47ca-b8da-876c5249f0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:56.448041 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45929f03-cb69-47ca-b8da-876c5249f0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:56.448287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45929f03-cb69-47ca-b8da-876c5249f0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:56.449019 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45929f03-cb69-47ca-b8da-876c5249f0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:56.463244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45929f03-cb69-47ca-b8da-876c5249f0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:56.464688 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45929f03-cb69-47ca-b8da-876c5249f0f0 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:56.476533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1097/2209] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:04.872799 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d3cd7-2619-4044-88ee-5cd58c3abef5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:04.873942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d3cd7-2619-4044-88ee-5cd58c3abef5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:04.874103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d3cd7-2619-4044-88ee-5cd58c3abef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:04.896320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-be0d3cd7-2619-4044-88ee-5cd58c3abef5 None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:04.897544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be0d3cd7-2619-4044-88ee-5cd58c3abef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:04.965180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1113/2210] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:51:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:04.979127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45929f03-cb69-47ca-b8da-876c5249f0f0 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:04.981190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-45929f03-cb69-47ca-b8da-876c5249f0f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:05.055134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45929f03-cb69-47ca-b8da-876c5249f0f0 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:05.060859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd611d24-4844-46a9-ae95-6056cd98277f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:05.061472 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611d24-4844-46a9-ae95-6056cd98277f service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:05.061749 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611d24-4844-46a9-ae95-6056cd98277f service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:05.062133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd611d24-4844-46a9-ae95-6056cd98277f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:05.071663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd611d24-4844-46a9-ae95-6056cd98277f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:05.073401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd611d24-4844-46a9-ae95-6056cd98277f service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:05.082377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1098/2211] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:51:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:14.951763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=82 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:15.078430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=49 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:23.933607 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d3cd7-2619-4044-88ee-5cd58c3abef5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:23.935088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-be0d3cd7-2619-4044-88ee-5cd58c3abef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:24.009713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d3cd7-2619-4044-88ee-5cd58c3abef5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:24.014915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535caf29-ba34-4bd5-95e7-106586219058 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:24.015555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535caf29-ba34-4bd5-95e7-106586219058 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:24.016265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535caf29-ba34-4bd5-95e7-106586219058 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:24.016265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535caf29-ba34-4bd5-95e7-106586219058 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:24.018345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-535caf29-ba34-4bd5-95e7-106586219058 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:24.030527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535caf29-ba34-4bd5-95e7-106586219058 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:24.032787 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535caf29-ba34-4bd5-95e7-106586219058 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:24.042734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1114/2212] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:51:26.872890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16998-b87e-478f-a5e6-f0f49e0fd71f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:26.873538 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16998-b87e-478f-a5e6-f0f49e0fd71f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:26.873538 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16998-b87e-478f-a5e6-f0f49e0fd71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:26.892828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-7fb16998-b87e-478f-a5e6-f0f49e0fd71f None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:26.894539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7fb16998-b87e-478f-a5e6-f0f49e0fd71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:26.901198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1099/2213] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 03:51:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:26.914943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535caf29-ba34-4bd5-95e7-106586219058 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:26.927579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535caf29-ba34-4bd5-95e7-106586219058 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:26.932576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46b2ec-ed0d-4f60-b7a4-4116743be8b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:26.933185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46b2ec-ed0d-4f60-b7a4-4116743be8b3 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:26.933469 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46b2ec-ed0d-4f60-b7a4-4116743be8b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:26.933746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46b2ec-ed0d-4f60-b7a4-4116743be8b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:26.942398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46b2ec-ed0d-4f60-b7a4-4116743be8b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:26.944032 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46b2ec-ed0d-4f60-b7a4-4116743be8b3 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:26.953770 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1115/2214] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:51:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:29.194562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a6f04-d1b4-4119-9881-acda33d4c634 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:29.195015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a6f04-d1b4-4119-9881-acda33d4c634 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:29.195143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a6f04-d1b4-4119-9881-acda33d4c634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:29.215827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b88a6f04-d1b4-4119-9881-acda33d4c634 None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:29.217074 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b88a6f04-d1b4-4119-9881-acda33d4c634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:29.225322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1100/2215] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:51:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:51:29.238660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46b2ec-ed0d-4f60-b7a4-4116743be8b3 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:29.249348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46b2ec-ed0d-4f60-b7a4-4116743be8b3 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:29.254624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6fa98-913b-4186-ab5f-67d643616c7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:29.255267 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6fa98-913b-4186-ab5f-67d643616c7a service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:29.255547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6fa98-913b-4186-ab5f-67d643616c7a service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:29.255822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6fa98-913b-4186-ab5f-67d643616c7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:29.267401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6fa98-913b-4186-ab5f-67d643616c7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:29.268940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6fa98-913b-4186-ab5f-67d643616c7a service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:29.277931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1116/2216] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:51:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:30.344383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6ae2b-d04c-4659-b96d-fe64912c3f30 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:30.344878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6ae2b-d04c-4659-b96d-fe64912c3f30 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:30.347997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6ae2b-d04c-4659-b96d-fe64912c3f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:30.376641 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-adc6ae2b-d04c-4659-b96d-fe64912c3f30 None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:30.378790 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-adc6ae2b-d04c-4659-b96d-fe64912c3f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:30.389603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1101/2217] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 03:51:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:30.402646 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6fa98-913b-4186-ab5f-67d643616c7a service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:30.413843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6fa98-913b-4186-ab5f-67d643616c7a service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:30.419251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f93b3-560f-4140-9946-0fdbfaeae078 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:30.419868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f93b3-560f-4140-9946-0fdbfaeae078 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:30.420151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f93b3-560f-4140-9946-0fdbfaeae078 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:30.420430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f93b3-560f-4140-9946-0fdbfaeae078 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:30.429002 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f93b3-560f-4140-9946-0fdbfaeae078 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:30.430592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f93b3-560f-4140-9946-0fdbfaeae078 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:30.439426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1117/2218] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:51:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:31.372144 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f61e77-b8b8-4c01-a2cd-ebfb9f48b3f6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:31.372599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f61e77-b8b8-4c01-a2cd-ebfb9f48b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:31.372686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f61e77-b8b8-4c01-a2cd-ebfb9f48b3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:31.405028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e2f61e77-b8b8-4c01-a2cd-ebfb9f48b3f6 None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:31.406266 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e2f61e77-b8b8-4c01-a2cd-ebfb9f48b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:31.416590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1102/2219] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:51:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:51:31.438676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f93b3-560f-4140-9946-0fdbfaeae078 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:31.450655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f93b3-560f-4140-9946-0fdbfaeae078 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:31.456353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f6ea5-723c-4e34-aba0-fe8a8a2b9f9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:31.456986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f6ea5-723c-4e34-aba0-fe8a8a2b9f9c service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:31.457272 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f6ea5-723c-4e34-aba0-fe8a8a2b9f9c service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:31.457579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f6ea5-723c-4e34-aba0-fe8a8a2b9f9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:31.467071 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f6ea5-723c-4e34-aba0-fe8a8a2b9f9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:31.468682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f6ea5-723c-4e34-aba0-fe8a8a2b9f9c service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:31.478202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1118/2220] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:51:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:31.543988 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32cb8-d1da-45a8-991f-f65fab1d7eb8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:31.544384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32cb8-d1da-45a8-991f-f65fab1d7eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:31.544769 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32cb8-d1da-45a8-991f-f65fab1d7eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:31.567994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-33c32cb8-d1da-45a8-991f-f65fab1d7eb8 None None] MFA Rules not processed for user `f7752cb1cf5d44b68ae08cfd5018d1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:31.569209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-33c32cb8-d1da-45a8-991f-f65fab1d7eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:31.576983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1103/2221] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:51:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:32.182262 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb403-9bb7-41eb-9165-f07cbd75a44d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:32.182631 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb403-9bb7-41eb-9165-f07cbd75a44d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:32.182907 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb403-9bb7-41eb-9165-f07cbd75a44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:32.202586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3e6eb403-9bb7-41eb-9165-f07cbd75a44d None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:32.204634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3e6eb403-9bb7-41eb-9165-f07cbd75a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:32.213556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1119/2222] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 03:51:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:32.230679 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32cb8-d1da-45a8-991f-f65fab1d7eb8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:32.244882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32cb8-d1da-45a8-991f-f65fab1d7eb8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:32.250392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b08636-1167-47f2-b6a1-e79ca64eccd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:32.251009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08636-1167-47f2-b6a1-e79ca64eccd3 service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:32.251343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08636-1167-47f2-b6a1-e79ca64eccd3 service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:32.251622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b08636-1167-47f2-b6a1-e79ca64eccd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:32.261839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b08636-1167-47f2-b6a1-e79ca64eccd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:32.263570 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b08636-1167-47f2-b6a1-e79ca64eccd3 service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:32.275742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1104/2223] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:51:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:35.221413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6eb403-9bb7-41eb-9165-f07cbd75a44d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:35.223016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3e6eb403-9bb7-41eb-9165-f07cbd75a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:35.241711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6eb403-9bb7-41eb-9165-f07cbd75a44d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:35.248598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:35.249337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:35.249630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:35.249892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] PATH_INFO: `/v3/users/75fe5a8612874ee0bae31d0d6a713bf7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:35.251463 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fe5a8612874ee0bae31d0d6a713bf7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:35.254119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:35.487375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fe5a8612874ee0bae31d0d6a713bf7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:35.488187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fe5a8612874ee0bae31d0d6a713bf7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:35.488917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fe5a8612874ee0bae31d0d6a713bf7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:35.601167 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fe5a8612874ee0bae31d0d6a713bf7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:35.623616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fe5a8612874ee0bae31d0d6a713bf7'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:35.639290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1120/2224] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:51:35 2022] DELETE /identity/v3/users/75fe5a8612874ee0bae31d0d6a713bf7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:35.644156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e91af-47df-4593-a734-8931cf3b563a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:35.647787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e91af-47df-4593-a734-8931cf3b563a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:35.647787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e91af-47df-4593-a734-8931cf3b563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:35.667754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ef5e91af-47df-4593-a734-8931cf3b563a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:35.669003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ef5e91af-47df-4593-a734-8931cf3b563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:35.742354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1105/2225] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:35.752549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:35.754007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:35.759410 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:35.815970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef9d32-ebe7-42bd-8869-d4710987a4f7 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:35.819824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f4088-fc08-40e7-8fec-e5f00fc4bfed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:35.820454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f4088-fc08-40e7-8fec-e5f00fc4bfed service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:35.820733 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f4088-fc08-40e7-8fec-e5f00fc4bfed service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:35.821005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f4088-fc08-40e7-8fec-e5f00fc4bfed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:35.832351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f4088-fc08-40e7-8fec-e5f00fc4bfed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:35.833842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f4088-fc08-40e7-8fec-e5f00fc4bfed service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:35.850004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1121/2226] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:36.181056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e91af-47df-4593-a734-8931cf3b563a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:36.186805 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ef5e91af-47df-4593-a734-8931cf3b563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:36.200205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e91af-47df-4593-a734-8931cf3b563a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:36.208620 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:36.210686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:36.210964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:36.211291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] PATH_INFO: `/v3/projects/3dee3060a262499a93d3075c82b0781b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:36.217825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dee3060a262499a93d3075c82b0781b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:36.217825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:36.387410 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dee3060a262499a93d3075c82b0781b', 'request_id': 'req-8078676f-70e0-4590-bd19-ca3b0d17439b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:36.395390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dee3060a262499a93d3075c82b0781b', 'request_id': 'req-8078676f-70e0-4590-bd19-ca3b0d17439b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:36.512411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dee3060a262499a93d3075c82b0781b', 'request_id': 'req-8078676f-70e0-4590-bd19-ca3b0d17439b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:36.527071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] The token cache is being invalidate because project 3dee3060a262499a93d3075c82b0781b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:51:36.527463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:36.528382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8078676f-70e0-4590-bd19-ca3b0d17439b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:36.529993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1106/2227] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:51:36 2022] DELETE /identity/v3/projects/3dee3060a262499a93d3075c82b0781b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:36.536035 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd979c-d0b7-4b10-906a-09359d471c04 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:36.536563 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd979c-d0b7-4b10-906a-09359d471c04 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:36.536563 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd979c-d0b7-4b10-906a-09359d471c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:36.562901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-96bd979c-d0b7-4b10-906a-09359d471c04 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:36.564190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-96bd979c-d0b7-4b10-906a-09359d471c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:36.640349 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1122/2228] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:36.648803 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7023f8f-7857-4f78-b991-2e43301633a8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:36.649333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7023f8f-7857-4f78-b991-2e43301633a8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:36.649477 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7023f8f-7857-4f78-b991-2e43301633a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:36.670955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a7023f8f-7857-4f78-b991-2e43301633a8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:36.672361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a7023f8f-7857-4f78-b991-2e43301633a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:36.680328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1107/2229] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:36.684769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd979c-d0b7-4b10-906a-09359d471c04 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:36.694877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd979c-d0b7-4b10-906a-09359d471c04 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:36.700479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60398-75a6-4da3-b50b-582a554326f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:36.701226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60398-75a6-4da3-b50b-582a554326f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:36.701650 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60398-75a6-4da3-b50b-582a554326f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:36.701933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60398-75a6-4da3-b50b-582a554326f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:36.702991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb60398-75a6-4da3-b50b-582a554326f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:51:36.703936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb60398-75a6-4da3-b50b-582a554326f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:36.706514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb60398-75a6-4da3-b50b-582a554326f3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:36.719842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1123/2230] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:51:36.724849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7023f8f-7857-4f78-b991-2e43301633a8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:36.734703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7023f8f-7857-4f78-b991-2e43301633a8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:36.739510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a8daf-e546-4cc3-b389-96a8bf3ef84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:36.740113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a8daf-e546-4cc3-b389-96a8bf3ef84c admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:36.740388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a8daf-e546-4cc3-b389-96a8bf3ef84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:36.740743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a8daf-e546-4cc3-b389-96a8bf3ef84c admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:36.741372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a8daf-e546-4cc3-b389-96a8bf3ef84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:36.743635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a8daf-e546-4cc3-b389-96a8bf3ef84c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:36.857778 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1108/2231] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:51:36 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:36.858923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60398-75a6-4da3-b50b-582a554326f3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:36.869949 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60398-75a6-4da3-b50b-582a554326f3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:36.937009 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111678fb-87d2-47a4-a3c2-3aa0c23494e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:36.937551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111678fb-87d2-47a4-a3c2-3aa0c23494e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:36.937865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111678fb-87d2-47a4-a3c2-3aa0c23494e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:36.938142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111678fb-87d2-47a4-a3c2-3aa0c23494e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:36.938779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111678fb-87d2-47a4-a3c2-3aa0c23494e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:36.940782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111678fb-87d2-47a4-a3c2-3aa0c23494e0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:37.056130 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1124/2232] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:51:36 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:51:37.060295 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a8daf-e546-4cc3-b389-96a8bf3ef84c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:37.070633 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a8daf-e546-4cc3-b389-96a8bf3ef84c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:37.075409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182c1b7-5d4d-4cbd-92e7-5c3b18d4b1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:37.076013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182c1b7-5d4d-4cbd-92e7-5c3b18d4b1cf admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:37.076299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182c1b7-5d4d-4cbd-92e7-5c3b18d4b1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:37.076570 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182c1b7-5d4d-4cbd-92e7-5c3b18d4b1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:37.077246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182c1b7-5d4d-4cbd-92e7-5c3b18d4b1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:37.078859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182c1b7-5d4d-4cbd-92e7-5c3b18d4b1cf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:37.081486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:37.091405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1109/2233] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:51:37.102090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111678fb-87d2-47a4-a3c2-3aa0c23494e0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:37.115497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111678fb-87d2-47a4-a3c2-3aa0c23494e0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:37.120512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45c510-362f-4013-8541-980277ca5855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:37.121126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45c510-362f-4013-8541-980277ca5855 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:37.130137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45c510-362f-4013-8541-980277ca5855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:37.130137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45c510-362f-4013-8541-980277ca5855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:37.130137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45c510-362f-4013-8541-980277ca5855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:37.130137 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45c510-362f-4013-8541-980277ca5855 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:37.134764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1125/2234] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:51:37.140666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182c1b7-5d4d-4cbd-92e7-5c3b18d4b1cf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:37.153838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182c1b7-5d4d-4cbd-92e7-5c3b18d4b1cf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:37.159280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be08f5b-67a1-429c-b39e-7bc2d49ae405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:37.159815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08f5b-67a1-429c-b39e-7bc2d49ae405 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:37.160095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08f5b-67a1-429c-b39e-7bc2d49ae405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:37.160372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08f5b-67a1-429c-b39e-7bc2d49ae405 admin admin] PATH_INFO: `/v3/projects/89ad6fb4e09240e288e9ae96b9f6b443/users/9a860afe6fe84559bf32f76567807889/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:37.175621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be08f5b-67a1-429c-b39e-7bc2d49ae405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ad6fb4e09240e288e9ae96b9f6b443, user_id=9a860afe6fe84559bf32f76567807889, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:37.178451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be08f5b-67a1-429c-b39e-7bc2d49ae405 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:37.253438 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1110/2235] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:51:37 2022] PUT /identity/v3/projects/89ad6fb4e09240e288e9ae96b9f6b443/users/9a860afe6fe84559bf32f76567807889/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:37.258594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071089bc-cf7a-4f4c-b9cd-eb321a7340dc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:37.258882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071089bc-cf7a-4f4c-b9cd-eb321a7340dc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:37.259197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071089bc-cf7a-4f4c-b9cd-eb321a7340dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:37.278712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-071089bc-cf7a-4f4c-b9cd-eb321a7340dc None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:37.279980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-071089bc-cf7a-4f4c-b9cd-eb321a7340dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:37.285607 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:37.341612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1126/2236] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:37.352238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be08f5b-67a1-429c-b39e-7bc2d49ae405 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:37.353999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8be08f5b-67a1-429c-b39e-7bc2d49ae405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:37.415600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be08f5b-67a1-429c-b39e-7bc2d49ae405 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:37.419386 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea9a45-248e-4ac5-a475-e9f5cae0687d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:37.420114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea9a45-248e-4ac5-a475-e9f5cae0687d service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:37.420385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea9a45-248e-4ac5-a475-e9f5cae0687d service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:37.420661 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea9a45-248e-4ac5-a475-e9f5cae0687d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:37.430635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea9a45-248e-4ac5-a475-e9f5cae0687d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:37.432147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea9a45-248e-4ac5-a475-e9f5cae0687d service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:37.443388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1111/2237] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:45.412948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5db319-eac7-4714-b403-41a6c7fc3d09 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:45.413496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5db319-eac7-4714-b403-41a6c7fc3d09 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:45.413496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5db319-eac7-4714-b403-41a6c7fc3d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:45.444126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7c5db319-eac7-4714-b403-41a6c7fc3d09 None None] MFA Rules not processed for user `9a860afe6fe84559bf32f76567807889`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:45.445368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7c5db319-eac7-4714-b403-41a6c7fc3d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:45.566768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1127/2238] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:51:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:45.572696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea9a45-248e-4ac5-a475-e9f5cae0687d service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:45.584159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea9a45-248e-4ac5-a475-e9f5cae0687d service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:45.589178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91ef2d-c25b-4556-a925-cc431c901d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:45.589955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ef2d-c25b-4556-a925-cc431c901d7e admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:45.590542 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ef2d-c25b-4556-a925-cc431c901d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:45.590818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ef2d-c25b-4556-a925-cc431c901d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:45.591497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91ef2d-c25b-4556-a925-cc431c901d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:45.593411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91ef2d-c25b-4556-a925-cc431c901d7e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:45.777487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1112/2239] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:51:45 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:51:45.779401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5db319-eac7-4714-b403-41a6c7fc3d09 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:45.799406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5db319-eac7-4714-b403-41a6c7fc3d09 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:45.892026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b242c-d3d0-4dbe-b4b6-74c8a4086219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:45.893427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b242c-d3d0-4dbe-b4b6-74c8a4086219 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:45.893873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b242c-d3d0-4dbe-b4b6-74c8a4086219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:45.894322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b242c-d3d0-4dbe-b4b6-74c8a4086219 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:45.895173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b242c-d3d0-4dbe-b4b6-74c8a4086219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:45.905799 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b242c-d3d0-4dbe-b4b6-74c8a4086219 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:46.028682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1128/2240] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:51:45 2022] POST /identity/v3/users => generated 298 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:46.032236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91ef2d-c25b-4556-a925-cc431c901d7e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:46.043704 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91ef2d-c25b-4556-a925-cc431c901d7e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:46.050107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ba80e-b20c-406b-a202-4fa086ccb022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:46.050896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ba80e-b20c-406b-a202-4fa086ccb022 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:46.051400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ba80e-b20c-406b-a202-4fa086ccb022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:46.051686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ba80e-b20c-406b-a202-4fa086ccb022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:46.052396 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ba80e-b20c-406b-a202-4fa086ccb022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:46.054290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ba80e-b20c-406b-a202-4fa086ccb022 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:46.068543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1113/2241] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:51:46.072823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b242c-d3d0-4dbe-b4b6-74c8a4086219 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:46.085731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b242c-d3d0-4dbe-b4b6-74c8a4086219 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:46.090934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfe2d1-43d9-46af-8e52-6885dff24d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:46.091775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe2d1-43d9-46af-8e52-6885dff24d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:46.092060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe2d1-43d9-46af-8e52-6885dff24d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:46.092289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe2d1-43d9-46af-8e52-6885dff24d81 admin admin] PATH_INFO: `/v3/projects/580b3fa971e34afa8035f1f700ac7a89/users/4f3bdb82261a4f3599fe5afb9665edda/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:46.109908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfe2d1-43d9-46af-8e52-6885dff24d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=580b3fa971e34afa8035f1f700ac7a89, user_id=4f3bdb82261a4f3599fe5afb9665edda, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:46.120520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfe2d1-43d9-46af-8e52-6885dff24d81 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:46.244618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1129/2242] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:51:46 2022] PUT /identity/v3/projects/580b3fa971e34afa8035f1f700ac7a89/users/4f3bdb82261a4f3599fe5afb9665edda/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:51:46.248812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ba80e-b20c-406b-a202-4fa086ccb022 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:46.260533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ba80e-b20c-406b-a202-4fa086ccb022 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:46.339222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387ca56-aaed-48f1-bc2a-a2a0e70236f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:46.339856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387ca56-aaed-48f1-bc2a-a2a0e70236f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:46.340146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387ca56-aaed-48f1-bc2a-a2a0e70236f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:46.340419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387ca56-aaed-48f1-bc2a-a2a0e70236f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:46.341081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387ca56-aaed-48f1-bc2a-a2a0e70236f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:46.343245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387ca56-aaed-48f1-bc2a-a2a0e70236f1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:46.355078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1114/2243] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:51:46.357960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfe2d1-43d9-46af-8e52-6885dff24d81 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:46.370450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfe2d1-43d9-46af-8e52-6885dff24d81 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:46.376236 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330e269-346e-4649-a206-14bab9abe1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:46.376835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e269-346e-4649-a206-14bab9abe1af admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:46.377120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e269-346e-4649-a206-14bab9abe1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:46.377405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e269-346e-4649-a206-14bab9abe1af admin admin] PATH_INFO: `/v3/projects/580b3fa971e34afa8035f1f700ac7a89/users/4f3bdb82261a4f3599fe5afb9665edda/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:46.379481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330e269-346e-4649-a206-14bab9abe1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=580b3fa971e34afa8035f1f700ac7a89, user_id=4f3bdb82261a4f3599fe5afb9665edda, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:46.382143 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330e269-346e-4649-a206-14bab9abe1af admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:46.384747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:46.393437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1130/2244] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:51:46 2022] PUT /identity/v3/projects/580b3fa971e34afa8035f1f700ac7a89/users/4f3bdb82261a4f3599fe5afb9665edda/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:53.722917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9398c8-caf6-4ce8-b2cc-6d3089e104d1 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:53.723512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9398c8-caf6-4ce8-b2cc-6d3089e104d1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:53.723512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9398c8-caf6-4ce8-b2cc-6d3089e104d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:53.752816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0f9398c8-caf6-4ce8-b2cc-6d3089e104d1 None None] MFA Rules not processed for user `4f3bdb82261a4f3599fe5afb9665edda`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:53.754071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0f9398c8-caf6-4ce8-b2cc-6d3089e104d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:53.786619 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:53.828040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1115/2245] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:51:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:53.840439 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330e269-346e-4649-a206-14bab9abe1af admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:53.847551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a330e269-346e-4649-a206-14bab9abe1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:53.907256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330e269-346e-4649-a206-14bab9abe1af admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:53.910785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43952925-1b65-4707-9194-fc4bde190bc9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6955fc5b81a040f686e21621ea968a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:53.911438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43952925-1b65-4707-9194-fc4bde190bc9 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:53.911713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43952925-1b65-4707-9194-fc4bde190bc9 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:53.911985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43952925-1b65-4707-9194-fc4bde190bc9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:53.979700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43952925-1b65-4707-9194-fc4bde190bc9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:53.981450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43952925-1b65-4707-9194-fc4bde190bc9 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:53.991680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1131/2246] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:54.255599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d24b8-aade-410a-bbb8-ee34644fe528 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:54.255959 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d24b8-aade-410a-bbb8-ee34644fe528 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:54.256309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d24b8-aade-410a-bbb8-ee34644fe528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:54.276539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-746d24b8-aade-410a-bbb8-ee34644fe528 None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:54.277785 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-746d24b8-aade-410a-bbb8-ee34644fe528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:54.335009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1116/2247] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:51:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:54.348401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43952925-1b65-4707-9194-fc4bde190bc9 service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:54.349835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-43952925-1b65-4707-9194-fc4bde190bc9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:54.433514 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43952925-1b65-4707-9194-fc4bde190bc9 service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:54.439383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cb96a-5aed-45e1-9a35-acb34d3ec70a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:54.440016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cb96a-5aed-45e1-9a35-acb34d3ec70a service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:54.440302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cb96a-5aed-45e1-9a35-acb34d3ec70a service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:54.440605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cb96a-5aed-45e1-9a35-acb34d3ec70a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:54.449999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cb96a-5aed-45e1-9a35-acb34d3ec70a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:54.451773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cb96a-5aed-45e1-9a35-acb34d3ec70a service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:54.464332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1132/2248] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:51:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:00.114746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c058cec-ed7b-4b2d-b7a4-b195971ce2db None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:00.115874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c058cec-ed7b-4b2d-b7a4-b195971ce2db None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:00.116551 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c058cec-ed7b-4b2d-b7a4-b195971ce2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:00.146409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-0c058cec-ed7b-4b2d-b7a4-b195971ce2db None None] MFA Rules not processed for user `f844fed122764361a93664842d60070e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:00.148550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0c058cec-ed7b-4b2d-b7a4-b195971ce2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:00.218542 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1117/2249] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:52:01.045450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ddc8e-96fb-40aa-99f7-ff3888bc42c4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:01.046857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ddc8e-96fb-40aa-99f7-ff3888bc42c4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:01.047437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ddc8e-96fb-40aa-99f7-ff3888bc42c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:01.071478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-701ddc8e-96fb-40aa-99f7-ff3888bc42c4 None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:01.073337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-701ddc8e-96fb-40aa-99f7-ff3888bc42c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:01.098291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1133/2250] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:52:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:01.124284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c058cec-ed7b-4b2d-b7a4-b195971ce2db None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:01.143354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c058cec-ed7b-4b2d-b7a4-b195971ce2db None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:01.149431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f18c3-ba25-48a1-b507-5ba24c352fd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:01.150307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f18c3-ba25-48a1-b507-5ba24c352fd8 service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:01.151128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f18c3-ba25-48a1-b507-5ba24c352fd8 service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:01.151810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f18c3-ba25-48a1-b507-5ba24c352fd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:01.163782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f18c3-ba25-48a1-b507-5ba24c352fd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:01.165994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f18c3-ba25-48a1-b507-5ba24c352fd8 service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:01.179038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1118/2251] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:52:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:08.895305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debec3a-89ac-4a3c-b55a-9287cdb9f7c0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:08.896083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debec3a-89ac-4a3c-b55a-9287cdb9f7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:08.896083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debec3a-89ac-4a3c-b55a-9287cdb9f7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:08.921676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9debec3a-89ac-4a3c-b55a-9287cdb9f7c0 None None] MFA Rules not processed for user `9a860afe6fe84559bf32f76567807889`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:08.922900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9debec3a-89ac-4a3c-b55a-9287cdb9f7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:08.930629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1134/2252] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:11.173677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=72 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:18.305938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20d185-2708-4d0a-a558-a8d9eb33e666 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:18.307025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20d185-2708-4d0a-a558-a8d9eb33e666 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:18.307695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20d185-2708-4d0a-a558-a8d9eb33e666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:18.358701 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9d20d185-2708-4d0a-a558-a8d9eb33e666 None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:18.360531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9d20d185-2708-4d0a-a558-a8d9eb33e666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:18.378578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1119/2253] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:52:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:18.398145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debec3a-89ac-4a3c-b55a-9287cdb9f7c0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:18.407090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:INSERT=1,keystone:SELECT=89 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:18.419924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debec3a-89ac-4a3c-b55a-9287cdb9f7c0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:18.433467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a2362-20ee-4c9d-a2f0-58b22f43fa56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:18.435146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a2362-20ee-4c9d-a2f0-58b22f43fa56 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:18.435618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a2362-20ee-4c9d-a2f0-58b22f43fa56 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:18.436226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a2362-20ee-4c9d-a2f0-58b22f43fa56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:18.451670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a2362-20ee-4c9d-a2f0-58b22f43fa56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:18.454302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a2362-20ee-4c9d-a2f0-58b22f43fa56 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:18.490672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1135/2254] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:52:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:23.425239 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c71fb-7224-4797-b2bd-12d099b66b74 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:23.425800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c71fb-7224-4797-b2bd-12d099b66b74 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:23.425800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c71fb-7224-4797-b2bd-12d099b66b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:23.446514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2f4c71fb-7224-4797-b2bd-12d099b66b74 None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:23.447800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2f4c71fb-7224-4797-b2bd-12d099b66b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:23.456848 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1120/2255] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 03:52:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:23.471352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a2362-20ee-4c9d-a2f0-58b22f43fa56 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:23.496236 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a2362-20ee-4c9d-a2f0-58b22f43fa56 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:23.514797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a143989-9030-47c1-86d7-0a29d547fc04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:23.515845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a143989-9030-47c1-86d7-0a29d547fc04 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:23.516400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a143989-9030-47c1-86d7-0a29d547fc04 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:23.516759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a143989-9030-47c1-86d7-0a29d547fc04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:23.535560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a143989-9030-47c1-86d7-0a29d547fc04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:23.537305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a143989-9030-47c1-86d7-0a29d547fc04 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:23.560254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1136/2256] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:52:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:28.281222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6317-eaa6-43d1-918f-72a3406aeca3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:28.282197 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6317-eaa6-43d1-918f-72a3406aeca3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:28.282475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6317-eaa6-43d1-918f-72a3406aeca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:28.305278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-919c6317-eaa6-43d1-918f-72a3406aeca3 None None] MFA Rules not processed for user `7f4db893c9404bf7b97c5b3ac47c9a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:28.306563 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-919c6317-eaa6-43d1-918f-72a3406aeca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:28.394482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1121/2257] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:29.963913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a143989-9030-47c1-86d7-0a29d547fc04 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:29.965455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1a143989-9030-47c1-86d7-0a29d547fc04 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:30.039280 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a143989-9030-47c1-86d7-0a29d547fc04 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:30.044350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281754a-8325-4fb4-b092-56d841fedee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:30.045066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281754a-8325-4fb4-b092-56d841fedee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:30.045722 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281754a-8325-4fb4-b092-56d841fedee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:30.045722 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281754a-8325-4fb4-b092-56d841fedee8 admin admin] PATH_INFO: `/v3/users/f7752cb1cf5d44b68ae08cfd5018d1be` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:30.046988 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281754a-8325-4fb4-b092-56d841fedee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7752cb1cf5d44b68ae08cfd5018d1be)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:30.049004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281754a-8325-4fb4-b092-56d841fedee8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:30.241201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d281754a-8325-4fb4-b092-56d841fedee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7752cb1cf5d44b68ae08cfd5018d1be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:30.241870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d281754a-8325-4fb4-b092-56d841fedee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7752cb1cf5d44b68ae08cfd5018d1be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:30.243156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d281754a-8325-4fb4-b092-56d841fedee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7752cb1cf5d44b68ae08cfd5018d1be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:30.310380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d281754a-8325-4fb4-b092-56d841fedee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7752cb1cf5d44b68ae08cfd5018d1be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:30.328642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d281754a-8325-4fb4-b092-56d841fedee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7752cb1cf5d44b68ae08cfd5018d1be'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:30.356255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1137/2258] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:52:29 2022] DELETE /identity/v3/users/f7752cb1cf5d44b68ae08cfd5018d1be => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:52:30.922230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c6317-eaa6-43d1-918f-72a3406aeca3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:30.935681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c6317-eaa6-43d1-918f-72a3406aeca3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:31.002413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:31.003072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:31.003356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:31.003630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] PATH_INFO: `/v3/projects/5f8ef06f64cc46598cc4f34e4a40e809` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:31.004827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8ef06f64cc46598cc4f34e4a40e809)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:31.006792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:31.128839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8ef06f64cc46598cc4f34e4a40e809', 'request_id': 'req-3b7f20c0-999c-46a5-9902-c0c08a25366d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:31.135923 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8ef06f64cc46598cc4f34e4a40e809', 'request_id': 'req-3b7f20c0-999c-46a5-9902-c0c08a25366d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:31.222479 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8ef06f64cc46598cc4f34e4a40e809', 'request_id': 'req-3b7f20c0-999c-46a5-9902-c0c08a25366d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:31.236135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] The token cache is being invalidate because project 5f8ef06f64cc46598cc4f34e4a40e809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:52:31.236427 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:31.237120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3b7f20c0-999c-46a5-9902-c0c08a25366d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:31.238631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1122/2259] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:52:30 2022] DELETE /identity/v3/projects/5f8ef06f64cc46598cc4f34e4a40e809 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:52:31.243579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a0ac4-899e-4d39-93ea-01313560c53c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:31.244094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a0ac4-899e-4d39-93ea-01313560c53c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:31.244367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a0ac4-899e-4d39-93ea-01313560c53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:31.265930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d46a0ac4-899e-4d39-93ea-01313560c53c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:31.267358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d46a0ac4-899e-4d39-93ea-01313560c53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:31.320598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:31.332442 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1138/2260] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:31.340303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e7420-3c63-4225-a2e9-e821b6af1efd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:31.340596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e7420-3c63-4225-a2e9-e821b6af1efd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:31.340877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e7420-3c63-4225-a2e9-e821b6af1efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:31.361727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ea5e7420-3c63-4225-a2e9-e821b6af1efd None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:31.362971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ea5e7420-3c63-4225-a2e9-e821b6af1efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:31.372639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1123/2261] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:31.377684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a0ac4-899e-4d39-93ea-01313560c53c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:31.387415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a0ac4-899e-4d39-93ea-01313560c53c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:31.391963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc367f-5eb6-4c0b-b6b5-9d9575c11039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:31.392560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc367f-5eb6-4c0b-b6b5-9d9575c11039 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:31.392842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc367f-5eb6-4c0b-b6b5-9d9575c11039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:31.393114 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc367f-5eb6-4c0b-b6b5-9d9575c11039 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:31.393761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc367f-5eb6-4c0b-b6b5-9d9575c11039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:52:31.394119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc367f-5eb6-4c0b-b6b5-9d9575c11039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:31.395808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc367f-5eb6-4c0b-b6b5-9d9575c11039 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:31.410700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1139/2262] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:52:31.411928 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e7420-3c63-4225-a2e9-e821b6af1efd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:31.422242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e7420-3c63-4225-a2e9-e821b6af1efd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:31.427204 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeea1b-1fcb-478e-afdc-78d5512c6a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:31.427808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeea1b-1fcb-478e-afdc-78d5512c6a7e admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:31.428114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeea1b-1fcb-478e-afdc-78d5512c6a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:31.428391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeea1b-1fcb-478e-afdc-78d5512c6a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:31.429065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeea1b-1fcb-478e-afdc-78d5512c6a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:31.431073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeea1b-1fcb-478e-afdc-78d5512c6a7e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:31.449003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:31.533170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1124/2263] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:52:31 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:52:31.534350 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc367f-5eb6-4c0b-b6b5-9d9575c11039 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:31.545296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc367f-5eb6-4c0b-b6b5-9d9575c11039 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:31.612591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0288-833d-432e-b62c-6f3a2ee021d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:31.613381 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0288-833d-432e-b62c-6f3a2ee021d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:31.613764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0288-833d-432e-b62c-6f3a2ee021d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:31.614048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0288-833d-432e-b62c-6f3a2ee021d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:31.614708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f0288-833d-432e-b62c-6f3a2ee021d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:31.616774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f0288-833d-432e-b62c-6f3a2ee021d9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:31.699941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1140/2264] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:52:31 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:52:31.704586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeea1b-1fcb-478e-afdc-78d5512c6a7e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:31.715943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeea1b-1fcb-478e-afdc-78d5512c6a7e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:31.721366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cb53a-bc24-4bb4-80f1-7774f669d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:31.721989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb53a-bc24-4bb4-80f1-7774f669d558 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:31.722265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb53a-bc24-4bb4-80f1-7774f669d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:31.722536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb53a-bc24-4bb4-80f1-7774f669d558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:31.723226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cb53a-bc24-4bb4-80f1-7774f669d558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:31.724883 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cb53a-bc24-4bb4-80f1-7774f669d558 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:31.737549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1125/2265] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:52:31.741590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0288-833d-432e-b62c-6f3a2ee021d9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:31.751814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0288-833d-432e-b62c-6f3a2ee021d9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:31.757589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd910d-b23a-48d8-b883-6b17781375ff None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:31.758050 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd910d-b23a-48d8-b883-6b17781375ff None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:31.758413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd910d-b23a-48d8-b883-6b17781375ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:31.763015 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb0e6-a181-463b-aedd-b45ea340881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:31.763895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb0e6-a181-463b-aedd-b45ea340881e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:31.764346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb0e6-a181-463b-aedd-b45ea340881e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:31.764956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb0e6-a181-463b-aedd-b45ea340881e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:31.765784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eeb0e6-a181-463b-aedd-b45ea340881e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:31.768083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eeb0e6-a181-463b-aedd-b45ea340881e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:31.778825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-43cd910d-b23a-48d8-b883-6b17781375ff None None] MFA Rules not processed for user `7463c60513914e138878f6eaf0a87473`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:31.780694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-43cd910d-b23a-48d8-b883-6b17781375ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:31.781857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1141/2266] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:52:31.785619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb0e6-a181-463b-aedd-b45ea340881e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:31.799759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb0e6-a181-463b-aedd-b45ea340881e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:31.805087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62f9af-3451-4349-b3c1-189ddea14de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:31.805621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62f9af-3451-4349-b3c1-189ddea14de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:31.805854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62f9af-3451-4349-b3c1-189ddea14de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:31.806069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62f9af-3451-4349-b3c1-189ddea14de1 admin admin] PATH_INFO: `/v3/projects/38282807602a48ba8c8e7d7f7ba0882a/users/e98113c46164463bb89045085224e42b/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:31.822372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62f9af-3451-4349-b3c1-189ddea14de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38282807602a48ba8c8e7d7f7ba0882a, user_id=e98113c46164463bb89045085224e42b, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:31.825185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62f9af-3451-4349-b3c1-189ddea14de1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:31.851497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1126/2267] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:31.928632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1142/2268] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:52:31 2022] PUT /identity/v3/projects/38282807602a48ba8c8e7d7f7ba0882a/users/e98113c46164463bb89045085224e42b/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:52:31.939818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526551b-ccdd-4943-95b9-d8301c64b58c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:31.947998 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526551b-ccdd-4943-95b9-d8301c64b58c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:31.947998 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526551b-ccdd-4943-95b9-d8301c64b58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:31.970411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-2526551b-ccdd-4943-95b9-d8301c64b58c None None] MFA Rules not processed for user `e98113c46164463bb89045085224e42b`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:31.971788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-2526551b-ccdd-4943-95b9-d8301c64b58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:32.040220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1127/2269] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:32.052120 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62f9af-3451-4349-b3c1-189ddea14de1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:32.054052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ba62f9af-3451-4349-b3c1-189ddea14de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:32.114034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62f9af-3451-4349-b3c1-189ddea14de1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:32.117708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2a9b9-685f-4705-9dc9-4c90b8284d3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:32.118319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a9b9-685f-4705-9dc9-4c90b8284d3c service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:32.118603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a9b9-685f-4705-9dc9-4c90b8284d3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:32.118877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a9b9-685f-4705-9dc9-4c90b8284d3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:32.127782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2a9b9-685f-4705-9dc9-4c90b8284d3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:32.129341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2a9b9-685f-4705-9dc9-4c90b8284d3c service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:32.140374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1143/2270] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:35.388929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526551b-ccdd-4943-95b9-d8301c64b58c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:35.458443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526551b-ccdd-4943-95b9-d8301c64b58c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:35.469310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:35.470112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:35.470383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:35.470660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] PATH_INFO: `/v3/users/e98113c46164463bb89045085224e42b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:35.471961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98113c46164463bb89045085224e42b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:35.474265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:35.495799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:35.695849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98113c46164463bb89045085224e42b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:35.829771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98113c46164463bb89045085224e42b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:35.838307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98113c46164463bb89045085224e42b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:35.839398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98113c46164463bb89045085224e42b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:35.879163 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98113c46164463bb89045085224e42b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:35.893185 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1128/2271] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:52:35 2022] DELETE /identity/v3/users/e98113c46164463bb89045085224e42b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:52:35.897445 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec73b9-5d64-41fa-a3aa-04039d8baf26 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:35.898171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec73b9-5d64-41fa-a3aa-04039d8baf26 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:35.898171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec73b9-5d64-41fa-a3aa-04039d8baf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:35.921429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-60ec73b9-5d64-41fa-a3aa-04039d8baf26 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:35.922643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-60ec73b9-5d64-41fa-a3aa-04039d8baf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:35.983826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:36.011311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1144/2272] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:52:36.022021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:36.027099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:36.114743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a5a67-3950-4942-9d73-b90ab55ff7ae admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:36.120399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ed879-28ab-4009-bb04-9c02b3d432d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:36.121406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed879-28ab-4009-bb04-9c02b3d432d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:36.121698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed879-28ab-4009-bb04-9c02b3d432d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:36.122456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed879-28ab-4009-bb04-9c02b3d432d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:36.134504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ed879-28ab-4009-bb04-9c02b3d432d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:36.138136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ed879-28ab-4009-bb04-9c02b3d432d5 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:36.151103 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1129/2273] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:36.627939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec73b9-5d64-41fa-a3aa-04039d8baf26 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:36.629699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-60ec73b9-5d64-41fa-a3aa-04039d8baf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:36.644655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec73b9-5d64-41fa-a3aa-04039d8baf26 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:36.652100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:36.652958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:36.653945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:36.654930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] PATH_INFO: `/v3/projects/38282807602a48ba8c8e7d7f7ba0882a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:36.656255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=38282807602a48ba8c8e7d7f7ba0882a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:36.658263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:36.830701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38282807602a48ba8c8e7d7f7ba0882a', 'request_id': 'req-df801d9d-964b-4125-8c4e-795404a1be0f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:36.939442 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38282807602a48ba8c8e7d7f7ba0882a', 'request_id': 'req-df801d9d-964b-4125-8c4e-795404a1be0f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:36.949455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38282807602a48ba8c8e7d7f7ba0882a', 'request_id': 'req-df801d9d-964b-4125-8c4e-795404a1be0f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:36.965533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] The token cache is being invalidate because project 38282807602a48ba8c8e7d7f7ba0882a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:52:36.965896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:36.970171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-df801d9d-964b-4125-8c4e-795404a1be0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:36.972186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1145/2274] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:52:36 2022] DELETE /identity/v3/projects/38282807602a48ba8c8e7d7f7ba0882a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:52:36.977228 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835ade8-1378-432c-92c9-149f1bd46f20 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:36.977228 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835ade8-1378-432c-92c9-149f1bd46f20 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:36.977858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835ade8-1378-432c-92c9-149f1bd46f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:37.004064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e835ade8-1378-432c-92c9-149f1bd46f20 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:37.005485 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e835ade8-1378-432c-92c9-149f1bd46f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:37.098353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1130/2275] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:52:37.106275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501eca2-712d-4883-ab96-9ad12230fdb4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:37.106642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501eca2-712d-4883-ab96-9ad12230fdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:37.106991 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501eca2-712d-4883-ab96-9ad12230fdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:37.133160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2501eca2-712d-4883-ab96-9ad12230fdb4 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:37.134512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2501eca2-712d-4883-ab96-9ad12230fdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:37.143285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1146/2276] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:37.148493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835ade8-1378-432c-92c9-149f1bd46f20 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:37.170812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835ade8-1378-432c-92c9-149f1bd46f20 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:37.170812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca187d81-4038-4ab0-91a7-bd8fd703c8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:37.170812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187d81-4038-4ab0-91a7-bd8fd703c8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:37.170812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187d81-4038-4ab0-91a7-bd8fd703c8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:37.171706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca187d81-4038-4ab0-91a7-bd8fd703c8a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:37.171706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca187d81-4038-4ab0-91a7-bd8fd703c8a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:52:37.171706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca187d81-4038-4ab0-91a7-bd8fd703c8a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:37.171706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca187d81-4038-4ab0-91a7-bd8fd703c8a1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:37.184408 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1131/2277] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:52:37.188775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501eca2-712d-4883-ab96-9ad12230fdb4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:37.198634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501eca2-712d-4883-ab96-9ad12230fdb4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:37.204091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b518a-eee0-436a-8b2e-463b8ba6c72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:37.204800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b518a-eee0-436a-8b2e-463b8ba6c72d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:37.205567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b518a-eee0-436a-8b2e-463b8ba6c72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:37.205567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b518a-eee0-436a-8b2e-463b8ba6c72d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:37.206176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b518a-eee0-436a-8b2e-463b8ba6c72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:37.208246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b518a-eee0-436a-8b2e-463b8ba6c72d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:37.318689 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1147/2278] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:52:37 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:52:37.323559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca187d81-4038-4ab0-91a7-bd8fd703c8a1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:37.336069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca187d81-4038-4ab0-91a7-bd8fd703c8a1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:37.365716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:37.402715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc20f28-1225-45cf-b80f-19216e9ce030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:37.403290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20f28-1225-45cf-b80f-19216e9ce030 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:37.403575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20f28-1225-45cf-b80f-19216e9ce030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:37.403856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20f28-1225-45cf-b80f-19216e9ce030 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:37.405065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc20f28-1225-45cf-b80f-19216e9ce030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:37.407240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc20f28-1225-45cf-b80f-19216e9ce030 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:37.508595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1132/2279] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:52:37 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:52:37.512756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b518a-eee0-436a-8b2e-463b8ba6c72d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:37.523443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b518a-eee0-436a-8b2e-463b8ba6c72d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:37.528264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2f514-2989-42b1-a75c-694042ce617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:37.528903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2f514-2989-42b1-a75c-694042ce617e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:37.529261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2f514-2989-42b1-a75c-694042ce617e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:37.529541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2f514-2989-42b1-a75c-694042ce617e admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:37.530200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2f514-2989-42b1-a75c-694042ce617e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:37.531875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2f514-2989-42b1-a75c-694042ce617e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:37.542520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1148/2280] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:52:37.547153 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc20f28-1225-45cf-b80f-19216e9ce030 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:37.561081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc20f28-1225-45cf-b80f-19216e9ce030 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:37.566214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00e7cc-eccc-44c3-8ff1-5a909939c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:37.566853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00e7cc-eccc-44c3-8ff1-5a909939c87f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:37.567218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00e7cc-eccc-44c3-8ff1-5a909939c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:37.567519 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00e7cc-eccc-44c3-8ff1-5a909939c87f admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:37.568224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00e7cc-eccc-44c3-8ff1-5a909939c87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:37.569958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00e7cc-eccc-44c3-8ff1-5a909939c87f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:37.580772 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1133/2281] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:52:37.585161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2f514-2989-42b1-a75c-694042ce617e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:37.595353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2f514-2989-42b1-a75c-694042ce617e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:37.600017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63417de7-ff9d-43ce-b4bf-49d2f9c01f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:37.604333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417de7-ff9d-43ce-b4bf-49d2f9c01f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:37.604333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417de7-ff9d-43ce-b4bf-49d2f9c01f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:37.604333 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417de7-ff9d-43ce-b4bf-49d2f9c01f27 admin admin] PATH_INFO: `/v3/projects/701a775ffb80483da86e0dfdfbfbbc27/users/1b467ad495c5450484c77ca6aec58068/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:37.616773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63417de7-ff9d-43ce-b4bf-49d2f9c01f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=701a775ffb80483da86e0dfdfbfbbc27, user_id=1b467ad495c5450484c77ca6aec58068, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:37.619587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63417de7-ff9d-43ce-b4bf-49d2f9c01f27 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:37.720384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1149/2282] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:52:37 2022] PUT /identity/v3/projects/701a775ffb80483da86e0dfdfbfbbc27/users/1b467ad495c5450484c77ca6aec58068/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:52:37.725689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122709e-280d-4aff-99a4-76e5ea95d9bb None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:37.725980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122709e-280d-4aff-99a4-76e5ea95d9bb None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:37.726258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122709e-280d-4aff-99a4-76e5ea95d9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:37.752254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a122709e-280d-4aff-99a4-76e5ea95d9bb None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:37.753843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a122709e-280d-4aff-99a4-76e5ea95d9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:37.817449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1134/2283] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:37.828000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63417de7-ff9d-43ce-b4bf-49d2f9c01f27 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:37.829839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-63417de7-ff9d-43ce-b4bf-49d2f9c01f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:37.892892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63417de7-ff9d-43ce-b4bf-49d2f9c01f27 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:37.896851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60a6c2-aff2-42f2-8528-9b5cddac04f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:37.897450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a6c2-aff2-42f2-8528-9b5cddac04f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:37.897795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a6c2-aff2-42f2-8528-9b5cddac04f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:37.898075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a6c2-aff2-42f2-8528-9b5cddac04f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:37.908630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60a6c2-aff2-42f2-8528-9b5cddac04f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:37.910653 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60a6c2-aff2-42f2-8528-9b5cddac04f5 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:37.921125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1150/2284] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:39.747402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1d2f-fac7-49ae-910d-034280ed2982 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:39.748480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1d2f-fac7-49ae-910d-034280ed2982 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:39.748480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1d2f-fac7-49ae-910d-034280ed2982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:39.806177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1bcc1d2f-fac7-49ae-910d-034280ed2982 None None] MFA Rules not processed for user `1b467ad495c5450484c77ca6aec58068`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:39.807471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1bcc1d2f-fac7-49ae-910d-034280ed2982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:39.910694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1135/2285] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:39.923233 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60a6c2-aff2-42f2-8528-9b5cddac04f5 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:39.924924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2b60a6c2-aff2-42f2-8528-9b5cddac04f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:39.931224 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:39.993434 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60a6c2-aff2-42f2-8528-9b5cddac04f5 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:40.000557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6110cfb-15c9-42fd-8f0f-27cd44147543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:40.001318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6110cfb-15c9-42fd-8f0f-27cd44147543 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:40.001667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6110cfb-15c9-42fd-8f0f-27cd44147543 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:40.002152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6110cfb-15c9-42fd-8f0f-27cd44147543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:40.012735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6110cfb-15c9-42fd-8f0f-27cd44147543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:40.018352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6110cfb-15c9-42fd-8f0f-27cd44147543 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:40.031364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1151/2286] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:42.881285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751b464-326c-4a79-b9e9-7e68a006d421 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:42.881764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751b464-326c-4a79-b9e9-7e68a006d421 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:42.881999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751b464-326c-4a79-b9e9-7e68a006d421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:42.902215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-6751b464-326c-4a79-b9e9-7e68a006d421 None None] MFA Rules not processed for user `1b467ad495c5450484c77ca6aec58068`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:42.903470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6751b464-326c-4a79-b9e9-7e68a006d421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:42.910941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1136/2287] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:45.626093 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585d2d9-16ea-4b91-ad8a-e48df0d716c5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:45.626619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585d2d9-16ea-4b91-ad8a-e48df0d716c5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:45.626752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585d2d9-16ea-4b91-ad8a-e48df0d716c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:45.647182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a585d2d9-16ea-4b91-ad8a-e48df0d716c5 None None] MFA Rules not processed for user `80d12d339c7e4908bb3fd773db3060cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:45.648421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a585d2d9-16ea-4b91-ad8a-e48df0d716c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:45.705599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1152/2288] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:52:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:52.131718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751b464-326c-4a79-b9e9-7e68a006d421 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:52.142858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751b464-326c-4a79-b9e9-7e68a006d421 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:52.146654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d9740-6a69-421d-9f9e-dea46386a3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:52.147412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d9740-6a69-421d-9f9e-dea46386a3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:52.147760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d9740-6a69-421d-9f9e-dea46386a3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:52.148099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d9740-6a69-421d-9f9e-dea46386a3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:52.149974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7c4d9740-6a69-421d-9f9e-dea46386a3f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:52.186804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:52.223485 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d9740-6a69-421d-9f9e-dea46386a3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:52.224942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d9740-6a69-421d-9f9e-dea46386a3f2 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:52.235893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1137/2289] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:55.697045 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=50 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:02.264869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=17 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:03.096586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585d2d9-16ea-4b91-ad8a-e48df0d716c5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:03.106269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585d2d9-16ea-4b91-ad8a-e48df0d716c5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:03.110488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dda72-4703-4dc9-bd19-3f64382f1f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:03.111121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dda72-4703-4dc9-bd19-3f64382f1f13 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:03.111409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dda72-4703-4dc9-bd19-3f64382f1f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:03.111684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dda72-4703-4dc9-bd19-3f64382f1f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:03.113461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dc1dda72-4703-4dc9-bd19-3f64382f1f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:03.192090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dda72-4703-4dc9-bd19-3f64382f1f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:03.193615 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dda72-4703-4dc9-bd19-3f64382f1f13 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:03.205081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1153/2290] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:53:09.497836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d9740-6a69-421d-9f9e-dea46386a3f2 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:09.510227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d9740-6a69-421d-9f9e-dea46386a3f2 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:09.514557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6661f6-fe71-4fc7-b957-26e9ef5b334a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:09.515208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6661f6-fe71-4fc7-b957-26e9ef5b334a service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:09.515519 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6661f6-fe71-4fc7-b957-26e9ef5b334a service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:09.515745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6661f6-fe71-4fc7-b957-26e9ef5b334a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:09.517622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5a6661f6-fe71-4fc7-b957-26e9ef5b334a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:09.539865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6661f6-fe71-4fc7-b957-26e9ef5b334a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:09.541337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6661f6-fe71-4fc7-b957-26e9ef5b334a service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:09.552440 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1138/2291] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:13.199920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=34 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:19.547520 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=6 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:24.219190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dda72-4703-4dc9-bd19-3f64382f1f13 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:24.219190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dda72-4703-4dc9-bd19-3f64382f1f13 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:24.221001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47149079-8594-42b3-8daf-f87e5fc98c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:24.221609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149079-8594-42b3-8daf-f87e5fc98c2b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:24.221888 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149079-8594-42b3-8daf-f87e5fc98c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:24.222158 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149079-8594-42b3-8daf-f87e5fc98c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:24.223908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-47149079-8594-42b3-8daf-f87e5fc98c2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:24.282336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47149079-8594-42b3-8daf-f87e5fc98c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:24.283733 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47149079-8594-42b3-8daf-f87e5fc98c2b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:24.293505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1154/2292] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:26.012317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a135b-001e-42c6-b1d1-4b60f5b52747 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:26.013381 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a135b-001e-42c6-b1d1-4b60f5b52747 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:26.013381 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a135b-001e-42c6-b1d1-4b60f5b52747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:26.035226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-439a135b-001e-42c6-b1d1-4b60f5b52747 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:26.036474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-439a135b-001e-42c6-b1d1-4b60f5b52747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:26.044676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1139/2293] 10.222.0.93 () {58 vars in 1016 bytes} [Wed Aug 24 03:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:26.066306 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47149079-8594-42b3-8daf-f87e5fc98c2b service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:26.067751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-47149079-8594-42b3-8daf-f87e5fc98c2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:26.084161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47149079-8594-42b3-8daf-f87e5fc98c2b service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:26.089561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d794b02-544c-42f1-a6f3-247f92e49683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:26.090171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d794b02-544c-42f1-a6f3-247f92e49683 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:26.090459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d794b02-544c-42f1-a6f3-247f92e49683 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:26.090738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d794b02-544c-42f1-a6f3-247f92e49683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:26.099810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d794b02-544c-42f1-a6f3-247f92e49683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:26.101412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d794b02-544c-42f1-a6f3-247f92e49683 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:26.111158 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1155/2294] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:26.220082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11cd8f-4d39-4880-9273-187a22180aea None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:26.220363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11cd8f-4d39-4880-9273-187a22180aea None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:26.220669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11cd8f-4d39-4880-9273-187a22180aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:26.240522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ae11cd8f-4d39-4880-9273-187a22180aea None None] MFA Rules not processed for user `f844fed122764361a93664842d60070e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:26.241940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ae11cd8f-4d39-4880-9273-187a22180aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:26.248999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1140/2295] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:53:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:26.558277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d794b02-544c-42f1-a6f3-247f92e49683 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:26.568117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d794b02-544c-42f1-a6f3-247f92e49683 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:26.571693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c02579-1ab7-4f20-8abc-d960969c43e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:26.572288 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c02579-1ab7-4f20-8abc-d960969c43e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:26.572565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c02579-1ab7-4f20-8abc-d960969c43e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:26.572836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c02579-1ab7-4f20-8abc-d960969c43e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:26.574802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-95c02579-1ab7-4f20-8abc-d960969c43e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:26.584993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c02579-1ab7-4f20-8abc-d960969c43e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:26.586427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c02579-1ab7-4f20-8abc-d960969c43e8 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:26.594225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1156/2296] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:27.022875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11cd8f-4d39-4880-9273-187a22180aea None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:27.024347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ae11cd8f-4d39-4880-9273-187a22180aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:27.094405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11cd8f-4d39-4880-9273-187a22180aea None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:27.099382 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c792a67-b266-466f-9fb5-e1f0430656eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:27.099991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c792a67-b266-466f-9fb5-e1f0430656eb service placement] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:27.100305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c792a67-b266-466f-9fb5-e1f0430656eb service placement] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:27.100583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c792a67-b266-466f-9fb5-e1f0430656eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:27.102304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3c792a67-b266-466f-9fb5-e1f0430656eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:27.113493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c792a67-b266-466f-9fb5-e1f0430656eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:27.115112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c792a67-b266-466f-9fb5-e1f0430656eb service placement] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:27.125367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1141/2297] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:28.828966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c02579-1ab7-4f20-8abc-d960969c43e8 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:28.838498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c02579-1ab7-4f20-8abc-d960969c43e8 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:28.842235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd1b8-e517-4aab-a23e-a555f1300b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:28.842838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd1b8-e517-4aab-a23e-a555f1300b86 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:28.843154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd1b8-e517-4aab-a23e-a555f1300b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:28.851061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd1b8-e517-4aab-a23e-a555f1300b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:28.851061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3b4fd1b8-e517-4aab-a23e-a555f1300b86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:28.905797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fd1b8-e517-4aab-a23e-a555f1300b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:28.907343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fd1b8-e517-4aab-a23e-a555f1300b86 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:28.917187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1157/2298] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:33.499555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487b6d5-16ce-47ad-9d4d-1e82af8a36dd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:33.500109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487b6d5-16ce-47ad-9d4d-1e82af8a36dd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:33.500109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487b6d5-16ce-47ad-9d4d-1e82af8a36dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:33.519559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c487b6d5-16ce-47ad-9d4d-1e82af8a36dd None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:33.520686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c487b6d5-16ce-47ad-9d4d-1e82af8a36dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:33.528448 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1142/2299] 10.222.0.93 () {58 vars in 1016 bytes} [Wed Aug 24 03:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:33.550558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd1b8-e517-4aab-a23e-a555f1300b86 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:33.564003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd1b8-e517-4aab-a23e-a555f1300b86 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:33.569450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbff7f3-fa99-4fa1-9ea2-c1fd9c47ed67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:33.570054 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff7f3-fa99-4fa1-9ea2-c1fd9c47ed67 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:33.570339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff7f3-fa99-4fa1-9ea2-c1fd9c47ed67 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:33.570616 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbff7f3-fa99-4fa1-9ea2-c1fd9c47ed67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:33.579256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbff7f3-fa99-4fa1-9ea2-c1fd9c47ed67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:33.580845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbff7f3-fa99-4fa1-9ea2-c1fd9c47ed67 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:33.590279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1158/2300] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:37.285042 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487b6d5-16ce-47ad-9d4d-1e82af8a36dd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:37.286452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c487b6d5-16ce-47ad-9d4d-1e82af8a36dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:37.299507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487b6d5-16ce-47ad-9d4d-1e82af8a36dd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:37.303670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15ed4b-cc66-4d10-a9b2-cbdebe55e190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:37.304304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15ed4b-cc66-4d10-a9b2-cbdebe55e190 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:37.304584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15ed4b-cc66-4d10-a9b2-cbdebe55e190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:37.304879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15ed4b-cc66-4d10-a9b2-cbdebe55e190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:37.306594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5c15ed4b-cc66-4d10-a9b2-cbdebe55e190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:37.316876 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15ed4b-cc66-4d10-a9b2-cbdebe55e190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:37.318353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15ed4b-cc66-4d10-a9b2-cbdebe55e190 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:37.326887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1143/2301] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:43.333913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31e5a8-40ba-41e6-88b3-1e5f97a0e78c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:43.334520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31e5a8-40ba-41e6-88b3-1e5f97a0e78c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:43.334520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31e5a8-40ba-41e6-88b3-1e5f97a0e78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:43.355290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7e31e5a8-40ba-41e6-88b3-1e5f97a0e78c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:43.356517 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7e31e5a8-40ba-41e6-88b3-1e5f97a0e78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:43.364750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1159/2302] 10.222.0.93 () {58 vars in 1016 bytes} [Wed Aug 24 03:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:43.387923 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15ed4b-cc66-4d10-a9b2-cbdebe55e190 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:43.401645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15ed4b-cc66-4d10-a9b2-cbdebe55e190 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:43.408287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128fb86-1c4a-4119-a81f-d8e80e81d8f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:43.408894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128fb86-1c4a-4119-a81f-d8e80e81d8f7 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:43.409166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128fb86-1c4a-4119-a81f-d8e80e81d8f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:43.409437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128fb86-1c4a-4119-a81f-d8e80e81d8f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:43.417810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128fb86-1c4a-4119-a81f-d8e80e81d8f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:43.421292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128fb86-1c4a-4119-a81f-d8e80e81d8f7 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:43.430116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1144/2303] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:48.001632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0c99-f655-45d8-81cd-7f25b2607c44 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:48.002189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0c99-f655-45d8-81cd-7f25b2607c44 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:48.002189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0c99-f655-45d8-81cd-7f25b2607c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:48.024286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-645e0c99-f655-45d8-81cd-7f25b2607c44 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:48.027904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-645e0c99-f655-45d8-81cd-7f25b2607c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:48.036013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1160/2304] 10.222.0.93 () {58 vars in 1016 bytes} [Wed Aug 24 03:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:48.061677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128fb86-1c4a-4119-a81f-d8e80e81d8f7 service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:48.073266 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128fb86-1c4a-4119-a81f-d8e80e81d8f7 service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:48.079728 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c100840-0ba1-4d79-a91b-13709dcf4a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:48.080347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100840-0ba1-4d79-a91b-13709dcf4a0d service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:48.080661 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100840-0ba1-4d79-a91b-13709dcf4a0d service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:48.080912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100840-0ba1-4d79-a91b-13709dcf4a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:48.089834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c100840-0ba1-4d79-a91b-13709dcf4a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:48.091490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c100840-0ba1-4d79-a91b-13709dcf4a0d service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:48.102452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1145/2305] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:49.322964 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0c99-f655-45d8-81cd-7f25b2607c44 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:49.324472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-645e0c99-f655-45d8-81cd-7f25b2607c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:49.340516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0c99-f655-45d8-81cd-7f25b2607c44 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:49.348177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03c7f6-7f71-4ee0-a7ee-f358452c85ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:49.348798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03c7f6-7f71-4ee0-a7ee-f358452c85ec service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:49.349467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03c7f6-7f71-4ee0-a7ee-f358452c85ec service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:49.349916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03c7f6-7f71-4ee0-a7ee-f358452c85ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:49.351709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5f03c7f6-7f71-4ee0-a7ee-f358452c85ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:49.396648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:49.412508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03c7f6-7f71-4ee0-a7ee-f358452c85ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:49.414016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03c7f6-7f71-4ee0-a7ee-f358452c85ec service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:49.424078 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1161/2306] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:50.902987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c100840-0ba1-4d79-a91b-13709dcf4a0d service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:50.910155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=60 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:50.916875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c100840-0ba1-4d79-a91b-13709dcf4a0d service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:50.923008 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f2714-58fd-42ee-913f-e512186e7b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:50.923652 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f2714-58fd-42ee-913f-e512186e7b88 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:50.923932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f2714-58fd-42ee-913f-e512186e7b88 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:50.924207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f2714-58fd-42ee-913f-e512186e7b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:50.925965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-6b2f2714-58fd-42ee-913f-e512186e7b88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:50.939391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f2714-58fd-42ee-913f-e512186e7b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:50.941124 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f2714-58fd-42ee-913f-e512186e7b88 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:50.953175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1146/2307] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:53.338089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a911c9-7705-4244-9780-023313c6260d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:53.338545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a911c9-7705-4244-9780-023313c6260d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:53.338639 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a911c9-7705-4244-9780-023313c6260d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:53.364231 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-92a911c9-7705-4244-9780-023313c6260d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:53.364231 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-92a911c9-7705-4244-9780-023313c6260d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:53.371705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1162/2308] 10.222.0.93 () {58 vars in 1016 bytes} [Wed Aug 24 03:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:53.395434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f2714-58fd-42ee-913f-e512186e7b88 service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:53.407007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f2714-58fd-42ee-913f-e512186e7b88 service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:53.412980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8866be1-4411-480e-96c7-c039eaec585f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:53.416086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8866be1-4411-480e-96c7-c039eaec585f service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:53.416086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8866be1-4411-480e-96c7-c039eaec585f service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:53.416086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8866be1-4411-480e-96c7-c039eaec585f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:53.423862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8866be1-4411-480e-96c7-c039eaec585f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:53.425460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8866be1-4411-480e-96c7-c039eaec585f service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:53.435294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1147/2309] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:55.319694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a911c9-7705-4244-9780-023313c6260d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:55.338112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a911c9-7705-4244-9780-023313c6260d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:55.347215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aefa6-0191-4148-9e67-3eb0ab36d731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:55.347927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aefa6-0191-4148-9e67-3eb0ab36d731 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:55.348279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aefa6-0191-4148-9e67-3eb0ab36d731 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:55.348626 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aefa6-0191-4148-9e67-3eb0ab36d731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:55.350584 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ef7aefa6-0191-4148-9e67-3eb0ab36d731 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:55.365090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aefa6-0191-4148-9e67-3eb0ab36d731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:55.366830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aefa6-0191-4148-9e67-3eb0ab36d731 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:55.380294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1163/2310] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:57.594815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebbfb5-12df-4a2f-8014-a198c6aaeb04 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:57.595389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebbfb5-12df-4a2f-8014-a198c6aaeb04 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:57.595389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebbfb5-12df-4a2f-8014-a198c6aaeb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:57.614835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-77ebbfb5-12df-4a2f-8014-a198c6aaeb04 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:57.616142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-77ebbfb5-12df-4a2f-8014-a198c6aaeb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:57.623965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1148/2311] 10.222.0.93 () {58 vars in 1016 bytes} [Wed Aug 24 03:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:57.650812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aefa6-0191-4148-9e67-3eb0ab36d731 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:57.659780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aefa6-0191-4148-9e67-3eb0ab36d731 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:57.665369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea03242-e0c2-4e25-a558-7289e3d1b741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:57.665970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea03242-e0c2-4e25-a558-7289e3d1b741 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:57.666256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea03242-e0c2-4e25-a558-7289e3d1b741 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:57.666535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea03242-e0c2-4e25-a558-7289e3d1b741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:57.674633 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea03242-e0c2-4e25-a558-7289e3d1b741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:57.676829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea03242-e0c2-4e25-a558-7289e3d1b741 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:57.685821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1164/2312] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:00.887650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebbfb5-12df-4a2f-8014-a198c6aaeb04 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:00.901849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebbfb5-12df-4a2f-8014-a198c6aaeb04 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:00.907932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2482c-ef8b-4a69-a0d1-0d3f1f6c842f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:00.909217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2482c-ef8b-4a69-a0d1-0d3f1f6c842f service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:00.909502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2482c-ef8b-4a69-a0d1-0d3f1f6c842f service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:00.909783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2482c-ef8b-4a69-a0d1-0d3f1f6c842f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:00.911627 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d2c2482c-ef8b-4a69-a0d1-0d3f1f6c842f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:00.924363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2482c-ef8b-4a69-a0d1-0d3f1f6c842f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:00.926119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2482c-ef8b-4a69-a0d1-0d3f1f6c842f service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:00.943158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1149/2313] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:03.140430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea03242-e0c2-4e25-a558-7289e3d1b741 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:03.150765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea03242-e0c2-4e25-a558-7289e3d1b741 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:03.154792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8fc3a-f5d9-483e-bb29-051ec96743d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:03.156044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8fc3a-f5d9-483e-bb29-051ec96743d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:03.156355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8fc3a-f5d9-483e-bb29-051ec96743d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:03.156631 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8fc3a-f5d9-483e-bb29-051ec96743d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:03.158432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-03b8fc3a-f5d9-483e-bb29-051ec96743d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:03.179334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8fc3a-f5d9-483e-bb29-051ec96743d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:03.180852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8fc3a-f5d9-483e-bb29-051ec96743d7 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:03.193579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1165/2314] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:07.338685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2482c-ef8b-4a69-a0d1-0d3f1f6c842f service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:07.352830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2482c-ef8b-4a69-a0d1-0d3f1f6c842f service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:07.358317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23973aa7-e967-4677-af64-15178eea79aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:07.358934 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973aa7-e967-4677-af64-15178eea79aa service placement] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:07.359297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973aa7-e967-4677-af64-15178eea79aa service placement] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:07.359503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23973aa7-e967-4677-af64-15178eea79aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:07.361365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-23973aa7-e967-4677-af64-15178eea79aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:07.374307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23973aa7-e967-4677-af64-15178eea79aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:07.376159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23973aa7-e967-4677-af64-15178eea79aa service placement] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:07.388502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1150/2315] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:07.511684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8fc3a-f5d9-483e-bb29-051ec96743d7 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:07.513648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-03b8fc3a-f5d9-483e-bb29-051ec96743d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:07.533102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8fc3a-f5d9-483e-bb29-051ec96743d7 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:07.539611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7656-b0bd-45e1-a01f-3d70641d3575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:07.540270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7656-b0bd-45e1-a01f-3d70641d3575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:07.540550 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7656-b0bd-45e1-a01f-3d70641d3575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:07.540830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7656-b0bd-45e1-a01f-3d70641d3575 admin admin] PATH_INFO: `/v3/users/7f4db893c9404bf7b97c5b3ac47c9a81` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:07.542044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7656-b0bd-45e1-a01f-3d70641d3575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4db893c9404bf7b97c5b3ac47c9a81)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:07.544155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7656-b0bd-45e1-a01f-3d70641d3575 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:07.753996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e65c7656-b0bd-45e1-a01f-3d70641d3575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4db893c9404bf7b97c5b3ac47c9a81'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:07.754655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e65c7656-b0bd-45e1-a01f-3d70641d3575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4db893c9404bf7b97c5b3ac47c9a81'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:07.755311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e65c7656-b0bd-45e1-a01f-3d70641d3575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4db893c9404bf7b97c5b3ac47c9a81'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:07.860203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e65c7656-b0bd-45e1-a01f-3d70641d3575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4db893c9404bf7b97c5b3ac47c9a81'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:07.880066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e65c7656-b0bd-45e1-a01f-3d70641d3575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4db893c9404bf7b97c5b3ac47c9a81'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:07.893024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1166/2316] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:54:07 2022] DELETE /identity/v3/users/7f4db893c9404bf7b97c5b3ac47c9a81 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:08.164139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23973aa7-e967-4677-af64-15178eea79aa service placement] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:08.176039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23973aa7-e967-4677-af64-15178eea79aa service placement] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:08.242178 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:08.242811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:08.243111 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:08.243383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] PATH_INFO: `/v3/projects/a2a5954902254a7c8877476e09cb7094` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:08.244506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a5954902254a7c8877476e09cb7094)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:08.246423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:08.352550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a5954902254a7c8877476e09cb7094', 'request_id': 'req-288122a6-dae5-4265-980b-5e601d0c9d92'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:08.358203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a5954902254a7c8877476e09cb7094', 'request_id': 'req-288122a6-dae5-4265-980b-5e601d0c9d92'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:08.452193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a5954902254a7c8877476e09cb7094', 'request_id': 'req-288122a6-dae5-4265-980b-5e601d0c9d92'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:08.463943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] The token cache is being invalidate because project a2a5954902254a7c8877476e09cb7094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:54:08.464235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:08.464869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-288122a6-dae5-4265-980b-5e601d0c9d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:08.466356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1151/2317] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:54:08 2022] DELETE /identity/v3/projects/a2a5954902254a7c8877476e09cb7094 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:08.472068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be4c1-970d-41bf-a673-b87c995a975d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:08.474044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be4c1-970d-41bf-a673-b87c995a975d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:08.474044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be4c1-970d-41bf-a673-b87c995a975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:08.492771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-678be4c1-970d-41bf-a673-b87c995a975d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:08.493987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-678be4c1-970d-41bf-a673-b87c995a975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:08.553518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1167/2318] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:08.561561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60393f-c8c8-4c54-b356-8d7fa1cebbac None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:08.561853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60393f-c8c8-4c54-b356-8d7fa1cebbac None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:08.562136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60393f-c8c8-4c54-b356-8d7fa1cebbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:08.581717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5e60393f-c8c8-4c54-b356-8d7fa1cebbac None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:08.582937 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5e60393f-c8c8-4c54-b356-8d7fa1cebbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:08.590786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1152/2319] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:08.595609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678be4c1-970d-41bf-a673-b87c995a975d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:08.605772 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678be4c1-970d-41bf-a673-b87c995a975d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:08.611175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae391326-7e7c-42c7-8e5d-ed391afe659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:08.611812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae391326-7e7c-42c7-8e5d-ed391afe659a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:08.612087 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae391326-7e7c-42c7-8e5d-ed391afe659a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:08.612361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae391326-7e7c-42c7-8e5d-ed391afe659a admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:08.613012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae391326-7e7c-42c7-8e5d-ed391afe659a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:54:08.613315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae391326-7e7c-42c7-8e5d-ed391afe659a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:08.614985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae391326-7e7c-42c7-8e5d-ed391afe659a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:08.617530 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:08.627183 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1168/2320] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:54:08.631634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60393f-c8c8-4c54-b356-8d7fa1cebbac None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:08.642075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60393f-c8c8-4c54-b356-8d7fa1cebbac None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:08.647285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6ccc7-f705-488a-9723-248170d9d7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:08.647896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6ccc7-f705-488a-9723-248170d9d7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:08.648179 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6ccc7-f705-488a-9723-248170d9d7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:08.648455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6ccc7-f705-488a-9723-248170d9d7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:08.651571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6ccc7-f705-488a-9723-248170d9d7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:08.651571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6ccc7-f705-488a-9723-248170d9d7d6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:08.772931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1153/2321] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:54:08 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:08.774177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae391326-7e7c-42c7-8e5d-ed391afe659a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:08.785750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae391326-7e7c-42c7-8e5d-ed391afe659a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:08.847795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec2314-6427-4a93-bb4a-9c9296602df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:08.848395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec2314-6427-4a93-bb4a-9c9296602df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:08.848682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec2314-6427-4a93-bb4a-9c9296602df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:08.848962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec2314-6427-4a93-bb4a-9c9296602df8 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:08.853123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec2314-6427-4a93-bb4a-9c9296602df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:08.853123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec2314-6427-4a93-bb4a-9c9296602df8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:09.003876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1169/2322] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:54:08 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:09.008040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6ccc7-f705-488a-9723-248170d9d7d6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:09.014766 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:09.018472 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6ccc7-f705-488a-9723-248170d9d7d6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:09.023077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa11167-c766-489c-8d4e-802e0a6c730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:09.023684 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11167-c766-489c-8d4e-802e0a6c730b admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:09.023965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11167-c766-489c-8d4e-802e0a6c730b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:09.024240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11167-c766-489c-8d4e-802e0a6c730b admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:09.024891 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa11167-c766-489c-8d4e-802e0a6c730b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:09.026677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa11167-c766-489c-8d4e-802e0a6c730b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:09.037359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1154/2323] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:09.043273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec2314-6427-4a93-bb4a-9c9296602df8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:09.054050 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec2314-6427-4a93-bb4a-9c9296602df8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:09.059175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3746b0f-6c86-46af-8761-202ecf9bd170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:09.059815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746b0f-6c86-46af-8761-202ecf9bd170 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:09.060063 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746b0f-6c86-46af-8761-202ecf9bd170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:09.060344 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746b0f-6c86-46af-8761-202ecf9bd170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:09.061000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3746b0f-6c86-46af-8761-202ecf9bd170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:09.062597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3746b0f-6c86-46af-8761-202ecf9bd170 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:09.074701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1170/2324] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:09.079148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa11167-c766-489c-8d4e-802e0a6c730b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:09.089091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa11167-c766-489c-8d4e-802e0a6c730b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:09.094250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01294d-0ee2-4acd-94c0-ac529dbc8fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:09.094895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01294d-0ee2-4acd-94c0-ac529dbc8fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:09.095290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01294d-0ee2-4acd-94c0-ac529dbc8fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:09.095569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01294d-0ee2-4acd-94c0-ac529dbc8fdf admin admin] PATH_INFO: `/v3/projects/e0fc9798c72d4ce8a950a32ac80c88f6/users/c443597f31cd4bb7b701064828736011/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:09.110856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01294d-0ee2-4acd-94c0-ac529dbc8fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fc9798c72d4ce8a950a32ac80c88f6, user_id=c443597f31cd4bb7b701064828736011, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:09.113574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01294d-0ee2-4acd-94c0-ac529dbc8fdf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:09.220816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1155/2325] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:54:09 2022] PUT /identity/v3/projects/e0fc9798c72d4ce8a950a32ac80c88f6/users/c443597f31cd4bb7b701064828736011/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:09.231785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522fb61-7231-45d7-bd19-1a1940c16a0a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:09.232075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522fb61-7231-45d7-bd19-1a1940c16a0a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:09.232383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522fb61-7231-45d7-bd19-1a1940c16a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:09.260324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-0522fb61-7231-45d7-bd19-1a1940c16a0a None None] MFA Rules not processed for user `c443597f31cd4bb7b701064828736011`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:09.261472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0522fb61-7231-45d7-bd19-1a1940c16a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:09.341733 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1171/2326] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:09.356087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01294d-0ee2-4acd-94c0-ac529dbc8fdf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:09.357822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-aa01294d-0ee2-4acd-94c0-ac529dbc8fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:09.434303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01294d-0ee2-4acd-94c0-ac529dbc8fdf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:09.439891 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739191dd-b665-4af0-ac7a-75e54ffd14fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:09.440497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739191dd-b665-4af0-ac7a-75e54ffd14fb service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:09.440777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739191dd-b665-4af0-ac7a-75e54ffd14fb service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:09.441054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739191dd-b665-4af0-ac7a-75e54ffd14fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:09.448750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739191dd-b665-4af0-ac7a-75e54ffd14fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:09.450590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739191dd-b665-4af0-ac7a-75e54ffd14fb service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:09.460034 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1156/2327] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:13.895619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522fb61-7231-45d7-bd19-1a1940c16a0a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:13.897313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0522fb61-7231-45d7-bd19-1a1940c16a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:13.931475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522fb61-7231-45d7-bd19-1a1940c16a0a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:13.938241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233770c-c3e7-4e45-9d97-e47ed8c7a36e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:13.938916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233770c-c3e7-4e45-9d97-e47ed8c7a36e service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:13.939289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233770c-c3e7-4e45-9d97-e47ed8c7a36e service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:13.939575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233770c-c3e7-4e45-9d97-e47ed8c7a36e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:13.941471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b233770c-c3e7-4e45-9d97-e47ed8c7a36e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:13.956431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233770c-c3e7-4e45-9d97-e47ed8c7a36e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:13.958220 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233770c-c3e7-4e45-9d97-e47ed8c7a36e service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:13.971105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1172/2328] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:14.747755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042a26c-f077-4fe6-a8a6-8431c33f8abd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:14.748256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042a26c-f077-4fe6-a8a6-8431c33f8abd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:14.748480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042a26c-f077-4fe6-a8a6-8431c33f8abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:14.768620 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e042a26c-f077-4fe6-a8a6-8431c33f8abd None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:14.769886 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e042a26c-f077-4fe6-a8a6-8431c33f8abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:14.835280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1157/2329] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:54:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:15.021962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233770c-c3e7-4e45-9d97-e47ed8c7a36e service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:15.023416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b233770c-c3e7-4e45-9d97-e47ed8c7a36e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:15.081107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:15.098299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233770c-c3e7-4e45-9d97-e47ed8c7a36e service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:15.103601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af9064-bf78-4d7e-9581-be20643da2e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:15.104219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9064-bf78-4d7e-9581-be20643da2e9 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:15.104502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9064-bf78-4d7e-9581-be20643da2e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:15.104775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9064-bf78-4d7e-9581-be20643da2e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:15.113293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af9064-bf78-4d7e-9581-be20643da2e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:15.115064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af9064-bf78-4d7e-9581-be20643da2e9 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:15.134443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1173/2330] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:54:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:16.262444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042a26c-f077-4fe6-a8a6-8431c33f8abd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:16.341446 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042a26c-f077-4fe6-a8a6-8431c33f8abd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:16.348567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:16.348567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:16.348567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:16.348845 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] PATH_INFO: `/v3/users/c443597f31cd4bb7b701064828736011` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:16.349944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c443597f31cd4bb7b701064828736011)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:16.352108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:16.354372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:16.641687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c443597f31cd4bb7b701064828736011'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:16.774655 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c443597f31cd4bb7b701064828736011'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:16.785224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c443597f31cd4bb7b701064828736011'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:16.785967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c443597f31cd4bb7b701064828736011'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:16.803505 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c443597f31cd4bb7b701064828736011'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:16.813967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1158/2331] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:54:16 2022] DELETE /identity/v3/users/c443597f31cd4bb7b701064828736011 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:16.818812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faee90-b742-4c40-ab33-3bc45b9459b8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:16.819413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faee90-b742-4c40-ab33-3bc45b9459b8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:16.819660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faee90-b742-4c40-ab33-3bc45b9459b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:16.844254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b3faee90-b742-4c40-ab33-3bc45b9459b8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:16.845661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b3faee90-b742-4c40-ab33-3bc45b9459b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:16.930996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1174/2332] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:16.942878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:16.944872 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:17.031529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c08a0e-9143-429a-9a63-6cfac3825295 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:17.036648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5534f-50d0-40b2-90a3-93434af656f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:17.037429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5534f-50d0-40b2-90a3-93434af656f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:17.037819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5534f-50d0-40b2-90a3-93434af656f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:17.038352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5534f-50d0-40b2-90a3-93434af656f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:17.052752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5534f-50d0-40b2-90a3-93434af656f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:17.054405 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5534f-50d0-40b2-90a3-93434af656f4 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:17.067756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1159/2333] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:18.018755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faee90-b742-4c40-ab33-3bc45b9459b8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:18.018755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b3faee90-b742-4c40-ab33-3bc45b9459b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:18.025741 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faee90-b742-4c40-ab33-3bc45b9459b8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:18.032491 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:18.033183 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:18.033470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:18.033749 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] PATH_INFO: `/v3/projects/e0fc9798c72d4ce8a950a32ac80c88f6` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:18.034920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fc9798c72d4ce8a950a32ac80c88f6)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:18.036986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:18.227606 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fc9798c72d4ce8a950a32ac80c88f6', 'request_id': 'req-f37245e2-ccb2-4791-86cb-54c7a1183471'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:18.316029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fc9798c72d4ce8a950a32ac80c88f6', 'request_id': 'req-f37245e2-ccb2-4791-86cb-54c7a1183471'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:18.323237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fc9798c72d4ce8a950a32ac80c88f6', 'request_id': 'req-f37245e2-ccb2-4791-86cb-54c7a1183471'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:18.337946 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] The token cache is being invalidate because project e0fc9798c72d4ce8a950a32ac80c88f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:54:18.338337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:18.339008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f37245e2-ccb2-4791-86cb-54c7a1183471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:18.340565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1175/2334] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:54:18 2022] DELETE /identity/v3/projects/e0fc9798c72d4ce8a950a32ac80c88f6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:18.360220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5d07-2886-4a68-ac79-ddcbd81360c5 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:18.361126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5d07-2886-4a68-ac79-ddcbd81360c5 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:18.361126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5d07-2886-4a68-ac79-ddcbd81360c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:18.393518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-799a5d07-2886-4a68-ac79-ddcbd81360c5 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:18.394783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-799a5d07-2886-4a68-ac79-ddcbd81360c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:18.469796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1160/2335] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:18.478699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e59eb-6b09-4442-a686-ce78bd12b626 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:18.478982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e59eb-6b09-4442-a686-ce78bd12b626 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:18.479489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e59eb-6b09-4442-a686-ce78bd12b626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:18.507069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d97e59eb-6b09-4442-a686-ce78bd12b626 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:18.508934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d97e59eb-6b09-4442-a686-ce78bd12b626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:18.522848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1176/2336] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:18.524273 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a5d07-2886-4a68-ac79-ddcbd81360c5 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:18.541361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a5d07-2886-4a68-ac79-ddcbd81360c5 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:18.543737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13acccd-0d4d-47df-ac48-5a11618825a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:18.546257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13acccd-0d4d-47df-ac48-5a11618825a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:18.546257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13acccd-0d4d-47df-ac48-5a11618825a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:18.546257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13acccd-0d4d-47df-ac48-5a11618825a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:18.546788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13acccd-0d4d-47df-ac48-5a11618825a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:54:18.547356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13acccd-0d4d-47df-ac48-5a11618825a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:18.550193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13acccd-0d4d-47df-ac48-5a11618825a0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:18.565757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1161/2337] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:54:18.570094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e59eb-6b09-4442-a686-ce78bd12b626 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:18.587101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e59eb-6b09-4442-a686-ce78bd12b626 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:18.595484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cf5cf-4b00-49e6-88b8-1cfe833bbe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:18.598468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cf5cf-4b00-49e6-88b8-1cfe833bbe38 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:18.598468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cf5cf-4b00-49e6-88b8-1cfe833bbe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:18.598468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cf5cf-4b00-49e6-88b8-1cfe833bbe38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:18.598468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cf5cf-4b00-49e6-88b8-1cfe833bbe38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:18.599931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cf5cf-4b00-49e6-88b8-1cfe833bbe38 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:18.718189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1177/2338] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:54:18 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:54:18.719159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13acccd-0d4d-47df-ac48-5a11618825a0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:18.734319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13acccd-0d4d-47df-ac48-5a11618825a0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:18.740951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:18.835799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365c4c1-83a1-44a6-9722-1c10d0e95b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:18.836517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c4c1-83a1-44a6-9722-1c10d0e95b43 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:18.836897 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c4c1-83a1-44a6-9722-1c10d0e95b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:18.837293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c4c1-83a1-44a6-9722-1c10d0e95b43 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:18.838062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365c4c1-83a1-44a6-9722-1c10d0e95b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:18.843646 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365c4c1-83a1-44a6-9722-1c10d0e95b43 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:18.878303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244637f-253c-4a52-ad04-0e657ffafe0f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:18.878630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244637f-253c-4a52-ad04-0e657ffafe0f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:18.879069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244637f-253c-4a52-ad04-0e657ffafe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:18.899668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3244637f-253c-4a52-ad04-0e657ffafe0f None None] MFA Rules not processed for user `1b467ad495c5450484c77ca6aec58068`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:18.901157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3244637f-253c-4a52-ad04-0e657ffafe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:18.943113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:18.974830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1178/2339] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:54:18.984138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1162/2340] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:54:18 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:54:18.993015 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244637f-253c-4a52-ad04-0e657ffafe0f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:19.025771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244637f-253c-4a52-ad04-0e657ffafe0f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:19.034236 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e8f17-57df-413f-89ec-0227ab17525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:19.036082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8f17-57df-413f-89ec-0227ab17525c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:19.036412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8f17-57df-413f-89ec-0227ab17525c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:19.036696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8f17-57df-413f-89ec-0227ab17525c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:19.038070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e8f17-57df-413f-89ec-0227ab17525c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:19.040291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e8f17-57df-413f-89ec-0227ab17525c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:19.059106 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1179/2341] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:19.062515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365c4c1-83a1-44a6-9722-1c10d0e95b43 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:19.082254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365c4c1-83a1-44a6-9722-1c10d0e95b43 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:19.098956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78702516-57d2-4160-a515-4c441a2c4ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:19.100012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702516-57d2-4160-a515-4c441a2c4ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:19.100393 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702516-57d2-4160-a515-4c441a2c4ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:19.100735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702516-57d2-4160-a515-4c441a2c4ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:19.101718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78702516-57d2-4160-a515-4c441a2c4ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:19.104059 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78702516-57d2-4160-a515-4c441a2c4ffe admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:19.122114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1163/2342] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:19.126217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e8f17-57df-413f-89ec-0227ab17525c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:19.140105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e8f17-57df-413f-89ec-0227ab17525c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:19.154319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf71ff-fc03-4263-89c4-a38c95515caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:19.155801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf71ff-fc03-4263-89c4-a38c95515caa admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:19.156135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf71ff-fc03-4263-89c4-a38c95515caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:19.156416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf71ff-fc03-4263-89c4-a38c95515caa admin admin] PATH_INFO: `/v3/projects/ca0b2b8c91bb46ab98e52d33aa310b1e/users/a427f44203cc4af29bd9c14cbf7a514e/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:19.180523 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf71ff-fc03-4263-89c4-a38c95515caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0b2b8c91bb46ab98e52d33aa310b1e, user_id=a427f44203cc4af29bd9c14cbf7a514e, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:19.184677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf71ff-fc03-4263-89c4-a38c95515caa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:19.283118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1180/2343] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:54:19 2022] PUT /identity/v3/projects/ca0b2b8c91bb46ab98e52d33aa310b1e/users/a427f44203cc4af29bd9c14cbf7a514e/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:19.293315 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105040-8e79-4f41-bfe6-4ddc0c08b3ce None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:19.293734 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105040-8e79-4f41-bfe6-4ddc0c08b3ce None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:19.294142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62105040-8e79-4f41-bfe6-4ddc0c08b3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:19.310536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf71ff-fc03-4263-89c4-a38c95515caa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:19.312527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-edaf71ff-fc03-4263-89c4-a38c95515caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:19.367119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-62105040-8e79-4f41-bfe6-4ddc0c08b3ce None None] MFA Rules not processed for user `a427f44203cc4af29bd9c14cbf7a514e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:19.368665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-62105040-8e79-4f41-bfe6-4ddc0c08b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:19.413650 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf71ff-fc03-4263-89c4-a38c95515caa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:19.418824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6a43f-f2dc-4e6a-8ff1-51aa76b94d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:19.419432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6a43f-f2dc-4e6a-8ff1-51aa76b94d96 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:19.420401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6a43f-f2dc-4e6a-8ff1-51aa76b94d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:19.420696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6a43f-f2dc-4e6a-8ff1-51aa76b94d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:19.423401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-17d6a43f-f2dc-4e6a-8ff1-51aa76b94d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:19.447288 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6a43f-f2dc-4e6a-8ff1-51aa76b94d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:19.448826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6a43f-f2dc-4e6a-8ff1-51aa76b94d96 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:19.458614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1164/2344] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:19.471587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1181/2345] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:19.472850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62105040-8e79-4f41-bfe6-4ddc0c08b3ce None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:19.474468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-62105040-8e79-4f41-bfe6-4ddc0c08b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:19.588350 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62105040-8e79-4f41-bfe6-4ddc0c08b3ce None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:19.595711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c13490-4580-4fe9-9096-5381b462bdca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:19.596940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c13490-4580-4fe9-9096-5381b462bdca service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:19.596940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c13490-4580-4fe9-9096-5381b462bdca service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:19.597476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c13490-4580-4fe9-9096-5381b462bdca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:19.613645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c13490-4580-4fe9-9096-5381b462bdca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:19.615419 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c13490-4580-4fe9-9096-5381b462bdca service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:19.626596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1165/2346] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:54:20.057651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6a43f-f2dc-4e6a-8ff1-51aa76b94d96 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:20.156351 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6a43f-f2dc-4e6a-8ff1-51aa76b94d96 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:20.164742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:20.165693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:20.166145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:20.166587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] PATH_INFO: `/v3/users/a427f44203cc4af29bd9c14cbf7a514e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:20.182238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a427f44203cc4af29bd9c14cbf7a514e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:20.186504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:20.464249 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a427f44203cc4af29bd9c14cbf7a514e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:20.466391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a427f44203cc4af29bd9c14cbf7a514e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:20.469406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a427f44203cc4af29bd9c14cbf7a514e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:20.476400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:20.632043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a427f44203cc4af29bd9c14cbf7a514e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:20.656273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a427f44203cc4af29bd9c14cbf7a514e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:20.681225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1182/2347] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:54:20 2022] DELETE /identity/v3/users/a427f44203cc4af29bd9c14cbf7a514e => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:20.681709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0ea5d-b4f2-4717-9657-c4609519953d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:20.681709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0ea5d-b4f2-4717-9657-c4609519953d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:20.681709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0ea5d-b4f2-4717-9657-c4609519953d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:20.698811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:20.718899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e8f0ea5d-b4f2-4717-9657-c4609519953d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:20.721796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e8f0ea5d-b4f2-4717-9657-c4609519953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:20.825677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1166/2348] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:54:20.838240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:20.853605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:20.928931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d59a3e-4c79-46a6-b55e-4db37cb84c3e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:20.932861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203abca-6933-4071-a933-a33326f75c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:20.933541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203abca-6933-4071-a933-a33326f75c1c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:20.933935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203abca-6933-4071-a933-a33326f75c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:20.934320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203abca-6933-4071-a933-a33326f75c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:20.946024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203abca-6933-4071-a933-a33326f75c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:20.947705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203abca-6933-4071-a933-a33326f75c1c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:20.966562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1183/2349] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:22.249459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0ea5d-b4f2-4717-9657-c4609519953d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:22.251294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e8f0ea5d-b4f2-4717-9657-c4609519953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:22.266469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0ea5d-b4f2-4717-9657-c4609519953d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:22.272154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:22.277884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:22.277884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:22.277884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] PATH_INFO: `/v3/projects/ca0b2b8c91bb46ab98e52d33aa310b1e` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:22.277884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0b2b8c91bb46ab98e52d33aa310b1e)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:22.277884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:22.448159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0b2b8c91bb46ab98e52d33aa310b1e', 'request_id': 'req-4ed26a51-e163-4c8f-adcf-346c893f5b11'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:22.456329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0b2b8c91bb46ab98e52d33aa310b1e', 'request_id': 'req-4ed26a51-e163-4c8f-adcf-346c893f5b11'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:22.538508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0b2b8c91bb46ab98e52d33aa310b1e', 'request_id': 'req-4ed26a51-e163-4c8f-adcf-346c893f5b11'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:22.557141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] The token cache is being invalidate because project ca0b2b8c91bb46ab98e52d33aa310b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:54:22.557840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:22.558729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4ed26a51-e163-4c8f-adcf-346c893f5b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:22.560656 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1167/2350] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:54:22 2022] DELETE /identity/v3/projects/ca0b2b8c91bb46ab98e52d33aa310b1e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:22.565319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3aa8e-724d-4eca-bc4c-90bca3f46d3c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:22.565909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3aa8e-724d-4eca-bc4c-90bca3f46d3c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:22.566029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3aa8e-724d-4eca-bc4c-90bca3f46d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:22.592734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e0b3aa8e-724d-4eca-bc4c-90bca3f46d3c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:22.594942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e0b3aa8e-724d-4eca-bc4c-90bca3f46d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:22.675820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1184/2351] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:22.685100 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce3b41-e5fc-405c-9b80-ee23dea44618 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:22.685451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce3b41-e5fc-405c-9b80-ee23dea44618 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:22.685703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce3b41-e5fc-405c-9b80-ee23dea44618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:22.738348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-76ce3b41-e5fc-405c-9b80-ee23dea44618 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:22.746218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-76ce3b41-e5fc-405c-9b80-ee23dea44618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:22.774628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1168/2352] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:22.781958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3aa8e-724d-4eca-bc4c-90bca3f46d3c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:22.807394 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3aa8e-724d-4eca-bc4c-90bca3f46d3c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:22.813900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105554f-278b-422f-a5d3-c0ecc99d7256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:22.814864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105554f-278b-422f-a5d3-c0ecc99d7256 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:22.815327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105554f-278b-422f-a5d3-c0ecc99d7256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:22.815696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105554f-278b-422f-a5d3-c0ecc99d7256 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:22.816520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105554f-278b-422f-a5d3-c0ecc99d7256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:54:22.816922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105554f-278b-422f-a5d3-c0ecc99d7256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:22.819435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105554f-278b-422f-a5d3-c0ecc99d7256 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:22.837211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1185/2353] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:54:22.841544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce3b41-e5fc-405c-9b80-ee23dea44618 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:22.853171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce3b41-e5fc-405c-9b80-ee23dea44618 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:22.863731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e0e9b-fd3f-4503-98dd-6d89ecff3b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:22.864632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0e9b-fd3f-4503-98dd-6d89ecff3b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:22.865082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0e9b-fd3f-4503-98dd-6d89ecff3b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:22.865424 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0e9b-fd3f-4503-98dd-6d89ecff3b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:22.866422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e0e9b-fd3f-4503-98dd-6d89ecff3b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:22.869127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e0e9b-fd3f-4503-98dd-6d89ecff3b02 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:23.010913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1169/2354] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:54:22 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:23.015869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105554f-278b-422f-a5d3-c0ecc99d7256 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:23.029806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105554f-278b-422f-a5d3-c0ecc99d7256 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:23.137419 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:23.153777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315cd2-7efc-47e6-b28a-52dc361ca9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:23.156924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315cd2-7efc-47e6-b28a-52dc361ca9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:23.157479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315cd2-7efc-47e6-b28a-52dc361ca9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:23.158492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315cd2-7efc-47e6-b28a-52dc361ca9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:23.159839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89315cd2-7efc-47e6-b28a-52dc361ca9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:23.163132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89315cd2-7efc-47e6-b28a-52dc361ca9f8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:23.269598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1186/2355] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:54:23 2022] POST /identity/v3/users => generated 283 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:23.273801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e0e9b-fd3f-4503-98dd-6d89ecff3b02 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:23.285196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e0e9b-fd3f-4503-98dd-6d89ecff3b02 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:23.290676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c759f-3be6-4dcc-8ed4-f1765f05c34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:23.291727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c759f-3be6-4dcc-8ed4-f1765f05c34c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:23.292216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c759f-3be6-4dcc-8ed4-f1765f05c34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:23.292707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c759f-3be6-4dcc-8ed4-f1765f05c34c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:23.293577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c759f-3be6-4dcc-8ed4-f1765f05c34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:23.295495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c759f-3be6-4dcc-8ed4-f1765f05c34c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:23.308701 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1170/2356] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:23.313358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315cd2-7efc-47e6-b28a-52dc361ca9f8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:23.325693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315cd2-7efc-47e6-b28a-52dc361ca9f8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:23.334231 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9be21a-57e9-4b21-97b1-05ea8d2dab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:23.338048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be21a-57e9-4b21-97b1-05ea8d2dab6b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:23.338048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be21a-57e9-4b21-97b1-05ea8d2dab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:23.338048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be21a-57e9-4b21-97b1-05ea8d2dab6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:23.338048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9be21a-57e9-4b21-97b1-05ea8d2dab6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:23.338987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9be21a-57e9-4b21-97b1-05ea8d2dab6b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:23.350716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1187/2357] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:23.354749 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c759f-3be6-4dcc-8ed4-f1765f05c34c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:23.369971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c759f-3be6-4dcc-8ed4-f1765f05c34c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:23.375947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aae14c-cb09-4fe1-900a-2db84e9781fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:23.376879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aae14c-cb09-4fe1-900a-2db84e9781fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:23.377434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aae14c-cb09-4fe1-900a-2db84e9781fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:23.377929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aae14c-cb09-4fe1-900a-2db84e9781fa admin admin] PATH_INFO: `/v3/projects/f0e3205e62f0464b99236f0531efd2a7/users/ac26d630e2f04d5089ca636d646c8671/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:23.406160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aae14c-cb09-4fe1-900a-2db84e9781fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e3205e62f0464b99236f0531efd2a7, user_id=ac26d630e2f04d5089ca636d646c8671, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:23.409317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aae14c-cb09-4fe1-900a-2db84e9781fa admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:23.530169 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1171/2358] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:54:23 2022] PUT /identity/v3/projects/f0e3205e62f0464b99236f0531efd2a7/users/ac26d630e2f04d5089ca636d646c8671/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:23.555877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6770e50-01ca-4cde-b73b-40987dcd971f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:23.561854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6770e50-01ca-4cde-b73b-40987dcd971f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:23.561854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6770e50-01ca-4cde-b73b-40987dcd971f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:23.608376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e6770e50-01ca-4cde-b73b-40987dcd971f None None] MFA Rules not processed for user `ac26d630e2f04d5089ca636d646c8671`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:23.610617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e6770e50-01ca-4cde-b73b-40987dcd971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:23.712862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1188/2359] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:23.715896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aae14c-cb09-4fe1-900a-2db84e9781fa admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:23.755248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:23.822837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aae14c-cb09-4fe1-900a-2db84e9781fa admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:23.830041 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167b48-42c4-4084-8126-f0ef37bf914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:23.831216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167b48-42c4-4084-8126-f0ef37bf914f admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:23.831571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167b48-42c4-4084-8126-f0ef37bf914f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:23.831846 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167b48-42c4-4084-8126-f0ef37bf914f admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:23.833264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47167b48-42c4-4084-8126-f0ef37bf914f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:23.835264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47167b48-42c4-4084-8126-f0ef37bf914f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:23.983122 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1172/2360] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:54:23 2022] POST /identity/v3/projects => generated 365 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:23.987843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6770e50-01ca-4cde-b73b-40987dcd971f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:24.001510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6770e50-01ca-4cde-b73b-40987dcd971f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:24.124015 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e498f06-a4b6-44a6-bc58-974cdc99398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:24.124904 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e498f06-a4b6-44a6-bc58-974cdc99398d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:24.125190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e498f06-a4b6-44a6-bc58-974cdc99398d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:24.125463 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e498f06-a4b6-44a6-bc58-974cdc99398d admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:24.126109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e498f06-a4b6-44a6-bc58-974cdc99398d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:24.128249 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e498f06-a4b6-44a6-bc58-974cdc99398d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:24.265575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1189/2361] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:54:23 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:24.266618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167b48-42c4-4084-8126-f0ef37bf914f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:24.279114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167b48-42c4-4084-8126-f0ef37bf914f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:24.287303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c475ab-342a-4e0b-8158-7020b27ad5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:24.288368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c475ab-342a-4e0b-8158-7020b27ad5ca admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:24.288900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c475ab-342a-4e0b-8158-7020b27ad5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:24.289583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c475ab-342a-4e0b-8158-7020b27ad5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:24.290635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c475ab-342a-4e0b-8158-7020b27ad5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:24.292592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c475ab-342a-4e0b-8158-7020b27ad5ca admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:24.312442 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e498f06-a4b6-44a6-bc58-974cdc99398d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:24.318171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1173/2362] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:54:24.328366 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e498f06-a4b6-44a6-bc58-974cdc99398d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:24.335520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315081d-ed8a-4595-901d-8e6b44acbc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:24.336217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315081d-ed8a-4595-901d-8e6b44acbc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:24.336498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315081d-ed8a-4595-901d-8e6b44acbc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:24.336923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315081d-ed8a-4595-901d-8e6b44acbc5c admin admin] PATH_INFO: `/v3/projects/4419a3217e714a74aa42cb9fd885b462/users/7a61a3e0a03e402499267de36adecb56/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:24.362787 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315081d-ed8a-4595-901d-8e6b44acbc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4419a3217e714a74aa42cb9fd885b462, user_id=7a61a3e0a03e402499267de36adecb56, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:24.368511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315081d-ed8a-4595-901d-8e6b44acbc5c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:24.472842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1190/2363] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:54:24 2022] PUT /identity/v3/projects/4419a3217e714a74aa42cb9fd885b462/users/7a61a3e0a03e402499267de36adecb56/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:24.478628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c475ab-342a-4e0b-8158-7020b27ad5ca admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:24.489660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c475ab-342a-4e0b-8158-7020b27ad5ca admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:24.589977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6e558-6e6a-457b-9598-d737dba80c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:24.590784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e558-6e6a-457b-9598-d737dba80c32 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:24.590991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e558-6e6a-457b-9598-d737dba80c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:24.591554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e558-6e6a-457b-9598-d737dba80c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:24.592850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6e558-6e6a-457b-9598-d737dba80c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:24.597475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6e558-6e6a-457b-9598-d737dba80c32 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:24.624379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1174/2364] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:24.626142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315081d-ed8a-4595-901d-8e6b44acbc5c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:24.643463 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315081d-ed8a-4595-901d-8e6b44acbc5c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:24.659808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693f1e4-9e15-4509-aece-f6ea8c0361e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:24.660505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693f1e4-9e15-4509-aece-f6ea8c0361e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:24.660845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693f1e4-9e15-4509-aece-f6ea8c0361e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:24.661124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693f1e4-9e15-4509-aece-f6ea8c0361e4 admin admin] PATH_INFO: `/v3/projects/4419a3217e714a74aa42cb9fd885b462/users/7a61a3e0a03e402499267de36adecb56/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:24.664576 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693f1e4-9e15-4509-aece-f6ea8c0361e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4419a3217e714a74aa42cb9fd885b462, user_id=7a61a3e0a03e402499267de36adecb56, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:24.670490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693f1e4-9e15-4509-aece-f6ea8c0361e4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:24.706423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1191/2365] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:54:24 2022] PUT /identity/v3/projects/4419a3217e714a74aa42cb9fd885b462/users/7a61a3e0a03e402499267de36adecb56/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:24.709642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd98dcd-ec58-48b0-82d8-6a5676a93bd2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:24.709958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd98dcd-ec58-48b0-82d8-6a5676a93bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:24.710235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd98dcd-ec58-48b0-82d8-6a5676a93bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:24.769339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8dd98dcd-ec58-48b0-82d8-6a5676a93bd2 None None] MFA Rules not processed for user `7a61a3e0a03e402499267de36adecb56`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:24.770783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8dd98dcd-ec58-48b0-82d8-6a5676a93bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:24.901661 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1175/2366] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:24.915129 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693f1e4-9e15-4509-aece-f6ea8c0361e4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:24.917446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9693f1e4-9e15-4509-aece-f6ea8c0361e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:24.954220 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:25.002181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693f1e4-9e15-4509-aece-f6ea8c0361e4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:25.006303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1f059-579e-4073-9f8a-7d0b09dbc072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:25.007006 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f059-579e-4073-9f8a-7d0b09dbc072 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:25.007536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f059-579e-4073-9f8a-7d0b09dbc072 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:25.007890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f059-579e-4073-9f8a-7d0b09dbc072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:25.021795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1f059-579e-4073-9f8a-7d0b09dbc072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:25.024472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1f059-579e-4073-9f8a-7d0b09dbc072 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:25.037511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1192/2367] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:25.262332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd98dcd-ec58-48b0-82d8-6a5676a93bd2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:25.279972 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd98dcd-ec58-48b0-82d8-6a5676a93bd2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:25.289670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5a78-4c54-42cd-be22-d4bba909f3eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:25.291909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5a78-4c54-42cd-be22-d4bba909f3eb service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:25.292198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5a78-4c54-42cd-be22-d4bba909f3eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:25.292480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5a78-4c54-42cd-be22-d4bba909f3eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:25.321105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:25.402248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5a78-4c54-42cd-be22-d4bba909f3eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:25.406081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5a78-4c54-42cd-be22-d4bba909f3eb service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:25.425841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1176/2368] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:35.086610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=18 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:35.417218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=20 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:36.397443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1f059-579e-4073-9f8a-7d0b09dbc072 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:36.474729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1f059-579e-4073-9f8a-7d0b09dbc072 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:36.480156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:36.480898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:36.481110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:36.481470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] PATH_INFO: `/v3/users/ac26d630e2f04d5089ca636d646c8671` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:36.483069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac26d630e2f04d5089ca636d646c8671)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:36.485037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:36.773650 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac26d630e2f04d5089ca636d646c8671'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:36.774305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac26d630e2f04d5089ca636d646c8671'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:36.774911 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac26d630e2f04d5089ca636d646c8671'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:36.925685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac26d630e2f04d5089ca636d646c8671'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:36.941725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac26d630e2f04d5089ca636d646c8671'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:36.957482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1193/2369] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:54:36 2022] DELETE /identity/v3/users/ac26d630e2f04d5089ca636d646c8671 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:36.962104 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf017-1be7-4f46-b795-3a4ada2b2bf6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:36.962559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf017-1be7-4f46-b795-3a4ada2b2bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:36.962692 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf017-1be7-4f46-b795-3a4ada2b2bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:36.982727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bdfcf017-1be7-4f46-b795-3a4ada2b2bf6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:36.984175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bdfcf017-1be7-4f46-b795-3a4ada2b2bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:37.058436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1177/2370] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:37.068286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:37.069697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:37.132382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb4587-7372-4e68-a0ef-d6de68ab30f1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:37.136083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605712f6-a90c-4dc1-844d-5826b7a9a7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:37.136816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605712f6-a90c-4dc1-844d-5826b7a9a7af service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:37.137099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605712f6-a90c-4dc1-844d-5826b7a9a7af service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:37.137375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605712f6-a90c-4dc1-844d-5826b7a9a7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:37.147989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605712f6-a90c-4dc1-844d-5826b7a9a7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:37.149516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605712f6-a90c-4dc1-844d-5826b7a9a7af service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:37.160518 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1194/2371] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:37.582483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcf017-1be7-4f46-b795-3a4ada2b2bf6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:37.584107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bdfcf017-1be7-4f46-b795-3a4ada2b2bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:37.597330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcf017-1be7-4f46-b795-3a4ada2b2bf6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:37.602828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:37.604370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:37.604922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:37.605461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] PATH_INFO: `/v3/projects/f0e3205e62f0464b99236f0531efd2a7` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:37.607777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e3205e62f0464b99236f0531efd2a7)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:37.610603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:37.672815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8265b1-72d9-4f68-a2f0-646ee6207516 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:37.673381 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8265b1-72d9-4f68-a2f0-646ee6207516 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:37.673479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8265b1-72d9-4f68-a2f0-646ee6207516 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:37.675331 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1195/2372] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:54:37.681256 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613db1e-5fb3-4c4e-be0d-e87c12a0fe35 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:37.681551 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613db1e-5fb3-4c4e-be0d-e87c12a0fe35 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:37.681833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613db1e-5fb3-4c4e-be0d-e87c12a0fe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:37.710192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d613db1e-5fb3-4c4e-be0d-e87c12a0fe35 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:37.711574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d613db1e-5fb3-4c4e-be0d-e87c12a0fe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:37.731857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:37.789964 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1196/2373] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:54:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:54:37.800977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613db1e-5fb3-4c4e-be0d-e87c12a0fe35 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:37.802376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d613db1e-5fb3-4c4e-be0d-e87c12a0fe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:37.832563 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e3205e62f0464b99236f0531efd2a7', 'request_id': 'req-9eee5f28-995e-4fd6-94eb-13253de75325'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:37.848159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e3205e62f0464b99236f0531efd2a7', 'request_id': 'req-9eee5f28-995e-4fd6-94eb-13253de75325'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:37.875801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613db1e-5fb3-4c4e-be0d-e87c12a0fe35 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:37.930962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddea84-5bd4-4d1d-9f0d-9bccc249990d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6955fc5b81a040f686e21621ea968a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:37.931617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddea84-5bd4-4d1d-9f0d-9bccc249990d service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:37.931903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddea84-5bd4-4d1d-9f0d-9bccc249990d service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:37.932189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddea84-5bd4-4d1d-9f0d-9bccc249990d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:37.976721 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e3205e62f0464b99236f0531efd2a7', 'request_id': 'req-9eee5f28-995e-4fd6-94eb-13253de75325'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:37.989957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] The token cache is being invalidate because project f0e3205e62f0464b99236f0531efd2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:54:37.990254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:37.990911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:37.993944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1178/2374] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:54:37 2022] DELETE /identity/v3/projects/f0e3205e62f0464b99236f0531efd2a7 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:54:38.000020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:38.001730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:38.010211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddea84-5bd4-4d1d-9f0d-9bccc249990d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:38.011714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddea84-5bd4-4d1d-9f0d-9bccc249990d service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:38.031115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1197/2375] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:54:38.086917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee5f28-995e-4fd6-94eb-13253de75325 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:38.092940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4bd0b-caa8-4209-a490-f1ef5b3e5dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:38.096450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4bd0b-caa8-4209-a490-f1ef5b3e5dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:38.096450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4bd0b-caa8-4209-a490-f1ef5b3e5dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:38.096450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4bd0b-caa8-4209-a490-f1ef5b3e5dd5 admin admin] PATH_INFO: `/v3/users/7a61a3e0a03e402499267de36adecb56` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:38.096450 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4bd0b-caa8-4209-a490-f1ef5b3e5dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a61a3e0a03e402499267de36adecb56)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:38.098640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4bd0b-caa8-4209-a490-f1ef5b3e5dd5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:38.237168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:38.275883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b3000-d27b-42fc-934c-8f7acf27fb13 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:38.276172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b3000-d27b-42fc-934c-8f7acf27fb13 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:38.276455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b3000-d27b-42fc-934c-8f7acf27fb13 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:38.277932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1198/2376] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:54:38.282956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bacc08-887e-4094-b034-24b6ce868795 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:38.283186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bacc08-887e-4094-b034-24b6ce868795 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:38.283489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bacc08-887e-4094-b034-24b6ce868795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:38.306242 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d5bacc08-887e-4094-b034-24b6ce868795 None None] MFA Rules not processed for user `b4ab7a3b191e4a0b84b396cafa8a9ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:38.307430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5bacc08-887e-4094-b034-24b6ce868795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:38.312812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:38.374788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0bd4bd0b-caa8-4209-a490-f1ef5b3e5dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a61a3e0a03e402499267de36adecb56'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:38.376774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1199/2377] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:54:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:54:38.394060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bacc08-887e-4094-b034-24b6ce868795 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:38.395678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d5bacc08-887e-4094-b034-24b6ce868795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:38.406615 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bacc08-887e-4094-b034-24b6ce868795 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:38.410309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6b23-12e8-42de-bfd8-99a5b68aa9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:38.410924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6b23-12e8-42de-bfd8-99a5b68aa9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:38.417736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6b23-12e8-42de-bfd8-99a5b68aa9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:38.417736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6b23-12e8-42de-bfd8-99a5b68aa9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:38.421842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac6b23-12e8-42de-bfd8-99a5b68aa9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:38.423330 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac6b23-12e8-42de-bfd8-99a5b68aa9d2 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:38.431533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1200/2378] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:38.498044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0bd4bd0b-caa8-4209-a490-f1ef5b3e5dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a61a3e0a03e402499267de36adecb56'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:38.508139 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0bd4bd0b-caa8-4209-a490-f1ef5b3e5dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a61a3e0a03e402499267de36adecb56'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:38.509464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0bd4bd0b-caa8-4209-a490-f1ef5b3e5dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a61a3e0a03e402499267de36adecb56'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:38.526694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0bd4bd0b-caa8-4209-a490-f1ef5b3e5dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a61a3e0a03e402499267de36adecb56'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:38.539622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1179/2379] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:54:37 2022] DELETE /identity/v3/users/7a61a3e0a03e402499267de36adecb56 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:38.542552 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f68f3-0867-4bbe-ba2e-9e4776681b98 None None] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:38.542863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f68f3-0867-4bbe-ba2e-9e4776681b98 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:38.543301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f68f3-0867-4bbe-ba2e-9e4776681b98 None None] PATH_INFO: `/` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:38.545575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1201/2380] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 03:54:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:54:38.552068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e3ec1-7322-4052-a9de-76aad25067d8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:38.555580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e3ec1-7322-4052-a9de-76aad25067d8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:38.555580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e3ec1-7322-4052-a9de-76aad25067d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:38.576171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-937e3ec1-7322-4052-a9de-76aad25067d8 None None] MFA Rules not processed for user `9624bc4b2840420eb06d721a73655da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:38.577435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-937e3ec1-7322-4052-a9de-76aad25067d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:38.670368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1180/2381] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 03:54:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:38.681637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f68f3-0867-4bbe-ba2e-9e4776681b98 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:38.683634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-623f68f3-0867-4bbe-ba2e-9e4776681b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:38.747249 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f68f3-0867-4bbe-ba2e-9e4776681b98 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:38.752357 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb448d-895a-47ff-b398-43192dcde380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:38.752994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb448d-895a-47ff-b398-43192dcde380 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:38.753325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb448d-895a-47ff-b398-43192dcde380 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:38.753605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb448d-895a-47ff-b398-43192dcde380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:38.770090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb448d-895a-47ff-b398-43192dcde380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:38.773799 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb448d-895a-47ff-b398-43192dcde380 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:38.790247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1202/2382] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:54:39.076752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e3ec1-7322-4052-a9de-76aad25067d8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:39.078223 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-937e3ec1-7322-4052-a9de-76aad25067d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:39.149016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e3ec1-7322-4052-a9de-76aad25067d8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:39.154279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:39.154987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:39.155305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:39.155580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] PATH_INFO: `/v3/projects/4419a3217e714a74aa42cb9fd885b462` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:39.156720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4419a3217e714a74aa42cb9fd885b462)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:39.158717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:39.316135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:39.328771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4419a3217e714a74aa42cb9fd885b462', 'request_id': 'req-df0025c9-d294-4752-bd22-8bb2804a8b1f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:39.339067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4419a3217e714a74aa42cb9fd885b462', 'request_id': 'req-df0025c9-d294-4752-bd22-8bb2804a8b1f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:39.428536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4419a3217e714a74aa42cb9fd885b462', 'request_id': 'req-df0025c9-d294-4752-bd22-8bb2804a8b1f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:39.441960 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] The token cache is being invalidate because project 4419a3217e714a74aa42cb9fd885b462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:54:39.442257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:39.442922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-df0025c9-d294-4752-bd22-8bb2804a8b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:39.444543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1181/2383] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:54:39 2022] DELETE /identity/v3/projects/4419a3217e714a74aa42cb9fd885b462 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:39.450278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925a0b-74ca-4256-9bc1-dc4118af70de None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:39.451132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925a0b-74ca-4256-9bc1-dc4118af70de None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:39.451418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925a0b-74ca-4256-9bc1-dc4118af70de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:39.475069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6b925a0b-74ca-4256-9bc1-dc4118af70de None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:39.476319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6b925a0b-74ca-4256-9bc1-dc4118af70de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:39.539486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1203/2384] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:54:39.547087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0309-dd96-4412-bddc-9df0af3d6ef6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:39.547383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0309-dd96-4412-bddc-9df0af3d6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:39.547659 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0309-dd96-4412-bddc-9df0af3d6ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:39.566996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bf5a0309-dd96-4412-bddc-9df0af3d6ef6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:39.568244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bf5a0309-dd96-4412-bddc-9df0af3d6ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:39.577381 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1182/2385] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:54:39.581857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b925a0b-74ca-4256-9bc1-dc4118af70de None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:39.598417 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b925a0b-74ca-4256-9bc1-dc4118af70de None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:39.603986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6aac07-73e4-432a-b533-f4c369faf27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:39.604644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aac07-73e4-432a-b533-f4c369faf27e admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:39.604926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aac07-73e4-432a-b533-f4c369faf27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:39.605219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6aac07-73e4-432a-b533-f4c369faf27e admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:39.605876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6aac07-73e4-432a-b533-f4c369faf27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:54:39.606198 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6aac07-73e4-432a-b533-f4c369faf27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:39.607875 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6aac07-73e4-432a-b533-f4c369faf27e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:39.620285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1204/2386] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:54:39.624871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a0309-dd96-4412-bddc-9df0af3d6ef6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:39.636784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a0309-dd96-4412-bddc-9df0af3d6ef6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:39.639818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d73dea-2d51-4195-97b4-1e51da69785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:39.640408 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d73dea-2d51-4195-97b4-1e51da69785b admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:39.640681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d73dea-2d51-4195-97b4-1e51da69785b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:39.640948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d73dea-2d51-4195-97b4-1e51da69785b admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:39.641579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d73dea-2d51-4195-97b4-1e51da69785b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:39.643525 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d73dea-2d51-4195-97b4-1e51da69785b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:39.772004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1183/2387] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:54:39 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:39.777796 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6aac07-73e4-432a-b533-f4c369faf27e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:39.784539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6aac07-73e4-432a-b533-f4c369faf27e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:39.820799 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:39.845731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd44b75-6239-436d-b3d6-22fa115723ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:39.846358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd44b75-6239-436d-b3d6-22fa115723ed admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:39.846638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd44b75-6239-436d-b3d6-22fa115723ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:39.846912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd44b75-6239-436d-b3d6-22fa115723ed admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:39.847590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd44b75-6239-436d-b3d6-22fa115723ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:39.849507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd44b75-6239-436d-b3d6-22fa115723ed admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:40.018712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1205/2388] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:54:39 2022] POST /identity/v3/users => generated 291 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:40.019311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d73dea-2d51-4195-97b4-1e51da69785b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:40.031283 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d73dea-2d51-4195-97b4-1e51da69785b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:40.041421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dbe59-8678-4f4f-aad1-f3fa2cbf6217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:40.041857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dbe59-8678-4f4f-aad1-f3fa2cbf6217 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:40.042185 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dbe59-8678-4f4f-aad1-f3fa2cbf6217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:40.042463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dbe59-8678-4f4f-aad1-f3fa2cbf6217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:40.043165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dbe59-8678-4f4f-aad1-f3fa2cbf6217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:40.045760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dbe59-8678-4f4f-aad1-f3fa2cbf6217 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:40.056569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1184/2389] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:54:40.060790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd44b75-6239-436d-b3d6-22fa115723ed admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:40.071944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd44b75-6239-436d-b3d6-22fa115723ed admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:40.076916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1d7dc-e65b-42df-9b6c-b4baa5064a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:40.077529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d7dc-e65b-42df-9b6c-b4baa5064a74 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:40.077812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d7dc-e65b-42df-9b6c-b4baa5064a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:40.078089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d7dc-e65b-42df-9b6c-b4baa5064a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:40.078753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1d7dc-e65b-42df-9b6c-b4baa5064a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:40.080444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1d7dc-e65b-42df-9b6c-b4baa5064a74 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:40.090729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1206/2390] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:40.095749 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dbe59-8678-4f4f-aad1-f3fa2cbf6217 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:40.106576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dbe59-8678-4f4f-aad1-f3fa2cbf6217 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:40.112081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7a803-af1f-4db1-a999-de57b67a44da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:40.114595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7a803-af1f-4db1-a999-de57b67a44da admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:40.114595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7a803-af1f-4db1-a999-de57b67a44da admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:40.114595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7a803-af1f-4db1-a999-de57b67a44da admin admin] PATH_INFO: `/v3/projects/68b6f389372c4488bfe32bed15d1c3fe/users/ff057c1c41cc42ea90ed029df1b67e81/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:40.129903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7a803-af1f-4db1-a999-de57b67a44da admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b6f389372c4488bfe32bed15d1c3fe, user_id=ff057c1c41cc42ea90ed029df1b67e81, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:40.132932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7a803-af1f-4db1-a999-de57b67a44da admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:40.369491 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1185/2391] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:54:40 2022] PUT /identity/v3/projects/68b6f389372c4488bfe32bed15d1c3fe/users/ff057c1c41cc42ea90ed029df1b67e81/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:40.379930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f598e-b192-4dac-b6dd-0bddbd2ae54c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:40.380224 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f598e-b192-4dac-b6dd-0bddbd2ae54c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:40.380507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f598e-b192-4dac-b6dd-0bddbd2ae54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:40.409231 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-437f598e-b192-4dac-b6dd-0bddbd2ae54c None None] MFA Rules not processed for user `ff057c1c41cc42ea90ed029df1b67e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:40.410566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-437f598e-b192-4dac-b6dd-0bddbd2ae54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:40.477165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1207/2392] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:40.481628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7a803-af1f-4db1-a999-de57b67a44da admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:40.554458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7a803-af1f-4db1-a999-de57b67a44da admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:40.559189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c474ba-0ac6-4802-ba7e-e1f4cc5b4093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:40.560304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c474ba-0ac6-4802-ba7e-e1f4cc5b4093 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:40.560585 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c474ba-0ac6-4802-ba7e-e1f4cc5b4093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:40.560895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c474ba-0ac6-4802-ba7e-e1f4cc5b4093 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:40.561533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c474ba-0ac6-4802-ba7e-e1f4cc5b4093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:40.563547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c474ba-0ac6-4802-ba7e-e1f4cc5b4093 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:40.683871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1186/2393] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:54:40 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:40.688659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f598e-b192-4dac-b6dd-0bddbd2ae54c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:40.700151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f598e-b192-4dac-b6dd-0bddbd2ae54c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:40.762301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de7869-3ac4-4aca-a7ae-0a345de07298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:40.762947 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7869-3ac4-4aca-a7ae-0a345de07298 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:40.763835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7869-3ac4-4aca-a7ae-0a345de07298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:40.764219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7869-3ac4-4aca-a7ae-0a345de07298 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:40.764860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de7869-3ac4-4aca-a7ae-0a345de07298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:40.766798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de7869-3ac4-4aca-a7ae-0a345de07298 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:40.858967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1208/2394] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:54:40 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:40.863842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c474ba-0ac6-4802-ba7e-e1f4cc5b4093 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:40.883106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c474ba-0ac6-4802-ba7e-e1f4cc5b4093 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:40.888449 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85231963-1443-46e7-b4ba-7334ca39eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:40.889066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231963-1443-46e7-b4ba-7334ca39eb5c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:40.889349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231963-1443-46e7-b4ba-7334ca39eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:40.889623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231963-1443-46e7-b4ba-7334ca39eb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:40.890284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85231963-1443-46e7-b4ba-7334ca39eb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:40.891999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85231963-1443-46e7-b4ba-7334ca39eb5c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:40.903094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1187/2395] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:40.907561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de7869-3ac4-4aca-a7ae-0a345de07298 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:40.918620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de7869-3ac4-4aca-a7ae-0a345de07298 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:40.924312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750a7f-8533-4a79-851d-a77196468681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:40.925082 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750a7f-8533-4a79-851d-a77196468681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:40.925460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750a7f-8533-4a79-851d-a77196468681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:40.925775 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750a7f-8533-4a79-851d-a77196468681 admin admin] PATH_INFO: `/v3/projects/a9ca7a13ae3e43959972b24c77e0d384/users/86b5e39418e14ab98641ed52c1a5b714/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:40.943710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3750a7f-8533-4a79-851d-a77196468681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ca7a13ae3e43959972b24c77e0d384, user_id=86b5e39418e14ab98641ed52c1a5b714, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:40.946751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3750a7f-8533-4a79-851d-a77196468681 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:41.013849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1209/2396] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:54:40 2022] PUT /identity/v3/projects/a9ca7a13ae3e43959972b24c77e0d384/users/86b5e39418e14ab98641ed52c1a5b714/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:41.017995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85231963-1443-46e7-b4ba-7334ca39eb5c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:41.028569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85231963-1443-46e7-b4ba-7334ca39eb5c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:41.063583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:41.090952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71009c-8d3d-45cc-b138-d4d7f0acd73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:41.091686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71009c-8d3d-45cc-b138-d4d7f0acd73e admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:41.091864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71009c-8d3d-45cc-b138-d4d7f0acd73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:41.092135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71009c-8d3d-45cc-b138-d4d7f0acd73e admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:41.092786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71009c-8d3d-45cc-b138-d4d7f0acd73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:41.094423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71009c-8d3d-45cc-b138-d4d7f0acd73e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:41.105787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1188/2397] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:41.110534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750a7f-8533-4a79-851d-a77196468681 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:41.123142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750a7f-8533-4a79-851d-a77196468681 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:41.128568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88d845-b22f-469f-8309-4811d30cdf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:41.129375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88d845-b22f-469f-8309-4811d30cdf70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:41.129779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88d845-b22f-469f-8309-4811d30cdf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:41.130948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88d845-b22f-469f-8309-4811d30cdf70 admin admin] PATH_INFO: `/v3/projects/a9ca7a13ae3e43959972b24c77e0d384/users/86b5e39418e14ab98641ed52c1a5b714/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:41.133062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88d845-b22f-469f-8309-4811d30cdf70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ca7a13ae3e43959972b24c77e0d384, user_id=86b5e39418e14ab98641ed52c1a5b714, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:41.139882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88d845-b22f-469f-8309-4811d30cdf70 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:41.146327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:41.153827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1210/2398] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:54:41 2022] PUT /identity/v3/projects/a9ca7a13ae3e43959972b24c77e0d384/users/86b5e39418e14ab98641ed52c1a5b714/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:54:41.164138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c76ffc-62eb-4fff-85bc-f9da66b872e6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:41.164429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c76ffc-62eb-4fff-85bc-f9da66b872e6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:41.164712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c76ffc-62eb-4fff-85bc-f9da66b872e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:41.202577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-82c76ffc-62eb-4fff-85bc-f9da66b872e6 None None] MFA Rules not processed for user `86b5e39418e14ab98641ed52c1a5b714`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:41.202577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-82c76ffc-62eb-4fff-85bc-f9da66b872e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:41.216292 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88d845-b22f-469f-8309-4811d30cdf70 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:41.218242 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5b88d845-b22f-469f-8309-4811d30cdf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:41.300242 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88d845-b22f-469f-8309-4811d30cdf70 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:41.307066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1189/2399] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:41.325434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c76ffc-62eb-4fff-85bc-f9da66b872e6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:41.327746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-82c76ffc-62eb-4fff-85bc-f9da66b872e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:41.332983 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55bb74-bcd9-4ad0-9cee-a2a4e9699ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:41.333622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55bb74-bcd9-4ad0-9cee-a2a4e9699ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:41.333908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55bb74-bcd9-4ad0-9cee-a2a4e9699ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:41.334189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55bb74-bcd9-4ad0-9cee-a2a4e9699ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:41.336191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d55bb74-bcd9-4ad0-9cee-a2a4e9699ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:41.448421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c76ffc-62eb-4fff-85bc-f9da66b872e6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:41.452305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55bb74-bcd9-4ad0-9cee-a2a4e9699ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:41.452584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aff59d-9ee8-4b59-ad97-40bcd62038cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:41.453217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aff59d-9ee8-4b59-ad97-40bcd62038cb service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:41.453500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aff59d-9ee8-4b59-ad97-40bcd62038cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:41.453780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aff59d-9ee8-4b59-ad97-40bcd62038cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:41.454534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55bb74-bcd9-4ad0-9cee-a2a4e9699ad9 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:41.463721 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aff59d-9ee8-4b59-ad97-40bcd62038cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:41.465181 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aff59d-9ee8-4b59-ad97-40bcd62038cb service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:41.468347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1211/2400] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:54:41.476944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1190/2401] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:41.593809 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55bb74-bcd9-4ad0-9cee-a2a4e9699ad9 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:41.595408 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2d55bb74-bcd9-4ad0-9cee-a2a4e9699ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:41.610231 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55bb74-bcd9-4ad0-9cee-a2a4e9699ad9 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:41.621062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753f7e4-97e3-4fce-af36-3a5e3887307a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:41.621719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f7e4-97e3-4fce-af36-3a5e3887307a service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:41.622007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f7e4-97e3-4fce-af36-3a5e3887307a service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:41.622555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f7e4-97e3-4fce-af36-3a5e3887307a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:41.698045 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753f7e4-97e3-4fce-af36-3a5e3887307a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:41.699475 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753f7e4-97e3-4fce-af36-3a5e3887307a service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:41.710153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1212/2402] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:42.517088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b51e9-fa9b-4fea-86a0-9c75a7892d39 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:42.517575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b51e9-fa9b-4fea-86a0-9c75a7892d39 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:42.517811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b51e9-fa9b-4fea-86a0-9c75a7892d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:42.537978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-573b51e9-fa9b-4fea-86a0-9c75a7892d39 None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:42.539307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-573b51e9-fa9b-4fea-86a0-9c75a7892d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:42.624108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1191/2403] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 03:54:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:42.645404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753f7e4-97e3-4fce-af36-3a5e3887307a service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:42.647540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f753f7e4-97e3-4fce-af36-3a5e3887307a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:42.713868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:42.737251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753f7e4-97e3-4fce-af36-3a5e3887307a service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:42.744981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f8b28-b436-4145-ac77-57e27a2920e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:42.745802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f8b28-b436-4145-ac77-57e27a2920e1 service swift] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:42.746189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f8b28-b436-4145-ac77-57e27a2920e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:42.746569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f8b28-b436-4145-ac77-57e27a2920e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:42.757273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f8b28-b436-4145-ac77-57e27a2920e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:42.758981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f8b28-b436-4145-ac77-57e27a2920e1 service swift] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:42.771363 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1213/2404] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:54:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:45.120338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c65516-559f-420b-a59e-3d3400aa6d3e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:45.122160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c65516-559f-420b-a59e-3d3400aa6d3e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:45.122586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c65516-559f-420b-a59e-3d3400aa6d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:45.137458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:45.154238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-93c65516-559f-420b-a59e-3d3400aa6d3e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:45.155953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-93c65516-559f-420b-a59e-3d3400aa6d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:45.168841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1192/2405] 10.222.0.93 () {58 vars in 1016 bytes} [Wed Aug 24 03:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:45.835652 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f8b28-b436-4145-ac77-57e27a2920e1 service swift] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:45.837141 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5a7f8b28-b436-4145-ac77-57e27a2920e1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:46.042366 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f8b28-b436-4145-ac77-57e27a2920e1 service swift] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:46.063761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f50e1-477f-437c-b707-13f42b76139d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:46.064749 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f50e1-477f-437c-b707-13f42b76139d service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:46.065045 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f50e1-477f-437c-b707-13f42b76139d service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:46.070358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f50e1-477f-437c-b707-13f42b76139d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:46.086582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f50e1-477f-437c-b707-13f42b76139d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:46.089634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f50e1-477f-437c-b707-13f42b76139d service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:46.143847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1214/2406] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:46.165767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c65516-559f-420b-a59e-3d3400aa6d3e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:46.179324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c65516-559f-420b-a59e-3d3400aa6d3e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:46.202850 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:46.203544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:46.203831 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:46.204101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] PATH_INFO: `/v3/users/ff057c1c41cc42ea90ed029df1b67e81` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:46.205286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff057c1c41cc42ea90ed029df1b67e81)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:46.207391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:46.506023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff057c1c41cc42ea90ed029df1b67e81'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:46.647712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff057c1c41cc42ea90ed029df1b67e81'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:46.661708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff057c1c41cc42ea90ed029df1b67e81'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:46.663434 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff057c1c41cc42ea90ed029df1b67e81'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:46.729475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff057c1c41cc42ea90ed029df1b67e81'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:46.754919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1193/2407] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:54:46 2022] DELETE /identity/v3/users/ff057c1c41cc42ea90ed029df1b67e81 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:46.761289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d912-89d0-471f-ae94-f29af5df2c5d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:46.761599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d912-89d0-471f-ae94-f29af5df2c5d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:46.761871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d912-89d0-471f-ae94-f29af5df2c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:46.801956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3505d912-89d0-471f-ae94-f29af5df2c5d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:46.805647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3505d912-89d0-471f-ae94-f29af5df2c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:46.970827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1215/2408] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:46.980866 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:46.982516 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:47.035504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505d912-89d0-471f-ae94-f29af5df2c5d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:47.037124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3505d912-89d0-471f-ae94-f29af5df2c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:47.059508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505d912-89d0-471f-ae94-f29af5df2c5d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:47.065255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:47.066094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:47.067216 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:47.067896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] PATH_INFO: `/v3/users/80d12d339c7e4908bb3fd773db3060cc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:47.069060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d12d339c7e4908bb3fd773db3060cc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:47.071356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:47.076316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3a10a-eb0a-44a6-b284-f69052dd6067 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:47.084968 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1666790-c19b-4266-a2a4-6c293e3d01e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:47.085718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1666790-c19b-4266-a2a4-6c293e3d01e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:47.086095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1666790-c19b-4266-a2a4-6c293e3d01e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:47.086464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1666790-c19b-4266-a2a4-6c293e3d01e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:47.098209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1666790-c19b-4266-a2a4-6c293e3d01e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:47.099868 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1666790-c19b-4266-a2a4-6c293e3d01e9 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:47.109622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1194/2409] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:47.449202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d12d339c7e4908bb3fd773db3060cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:47.450489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d12d339c7e4908bb3fd773db3060cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:47.452809 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d12d339c7e4908bb3fd773db3060cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:47.565632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d12d339c7e4908bb3fd773db3060cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:47.568409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:47.589294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d12d339c7e4908bb3fd773db3060cc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:47.627099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1216/2410] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:54:47 2022] DELETE /identity/v3/users/80d12d339c7e4908bb3fd773db3060cc => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:47.727672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1666790-c19b-4266-a2a4-6c293e3d01e9 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:47.734131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c1666790-c19b-4266-a2a4-6c293e3d01e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:47.774191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1666790-c19b-4266-a2a4-6c293e3d01e9 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:47.894934 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:47.896611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:47.897117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:47.897732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] PATH_INFO: `/v3/projects/68b6f389372c4488bfe32bed15d1c3fe` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:47.899499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b6f389372c4488bfe32bed15d1c3fe)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:47.902799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:47.925971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:48.773444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b6f389372c4488bfe32bed15d1c3fe', 'request_id': 'req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:48.780311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b6f389372c4488bfe32bed15d1c3fe', 'request_id': 'req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:48.807385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:48.808920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:48.828326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1328a4a-34d3-4be1-8293-ce1e81b69518 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:48.887529 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b6f389372c4488bfe32bed15d1c3fe', 'request_id': 'req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:48.905161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] The token cache is being invalidate because project 68b6f389372c4488bfe32bed15d1c3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:54:48.905853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:48.906800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:48.911240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1195/2411] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:54:47 2022] DELETE /identity/v3/projects/68b6f389372c4488bfe32bed15d1c3fe => generated 0 bytes in 1184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:48.915111 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:48.917553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:48.971800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:48.981390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:48.981887 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:48.982322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] PATH_INFO: `/v3/projects/bffce6843cd84332b456422305e102ec` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:48.983854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=bffce6843cd84332b456422305e102ec)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:48.986128 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:49.092430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b40e5-26f4-42eb-a53c-16a619ab8c5b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:49.100936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:49.103302 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:49.103550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:49.103811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] PATH_INFO: `/v3/users/86b5e39418e14ab98641ed52c1a5b714` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:49.108204 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b5e39418e14ab98641ed52c1a5b714)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:49.115671 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:49.172207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bffce6843cd84332b456422305e102ec', 'request_id': 'req-17ddba9e-2a96-4868-8dba-2d44076f4eff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:49.297447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bffce6843cd84332b456422305e102ec', 'request_id': 'req-17ddba9e-2a96-4868-8dba-2d44076f4eff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:49.310887 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bffce6843cd84332b456422305e102ec', 'request_id': 'req-17ddba9e-2a96-4868-8dba-2d44076f4eff'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:49.335586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] The token cache is being invalidate because project bffce6843cd84332b456422305e102ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:54:49.337508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:49.337508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-17ddba9e-2a96-4868-8dba-2d44076f4eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:49.338709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1217/2412] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:54:48 2022] DELETE /identity/v3/projects/bffce6843cd84332b456422305e102ec => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:54:49.344136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fbe65-1e6f-456b-8842-d8622703d368 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:49.344594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fbe65-1e6f-456b-8842-d8622703d368 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:49.344884 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fbe65-1e6f-456b-8842-d8622703d368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:49.371978 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-dc0fbe65-1e6f-456b-8842-d8622703d368 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:49.371978 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dc0fbe65-1e6f-456b-8842-d8622703d368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:49.411695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b5e39418e14ab98641ed52c1a5b714'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:49.463219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1218/2413] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:54:49.466589 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731423b8-d083-4aa0-b80e-a8b8c62bf2ca None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:49.466981 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731423b8-d083-4aa0-b80e-a8b8c62bf2ca None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:49.467296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731423b8-d083-4aa0-b80e-a8b8c62bf2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:49.503913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-731423b8-d083-4aa0-b80e-a8b8c62bf2ca None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:49.505569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-731423b8-d083-4aa0-b80e-a8b8c62bf2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:49.518659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1219/2414] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:49.520719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731423b8-d083-4aa0-b80e-a8b8c62bf2ca None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:49.524177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b5e39418e14ab98641ed52c1a5b714'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:49.532536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731423b8-d083-4aa0-b80e-a8b8c62bf2ca None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:49.536048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b5e39418e14ab98641ed52c1a5b714'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:49.537058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b5e39418e14ab98641ed52c1a5b714'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:49.539655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae047a2-8d50-42fb-8e0e-c206ff2561b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:49.540734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae047a2-8d50-42fb-8e0e-c206ff2561b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:49.541358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae047a2-8d50-42fb-8e0e-c206ff2561b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:49.541933 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae047a2-8d50-42fb-8e0e-c206ff2561b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:49.542960 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae047a2-8d50-42fb-8e0e-c206ff2561b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:54:49.543880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae047a2-8d50-42fb-8e0e-c206ff2561b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:49.546548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae047a2-8d50-42fb-8e0e-c206ff2561b0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:49.553844 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b5e39418e14ab98641ed52c1a5b714'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:49.558046 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:49.567025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1196/2415] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:54:48 2022] DELETE /identity/v3/users/86b5e39418e14ab98641ed52c1a5b714 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:54:49.570647 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1220/2416] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:54:49.578959 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:49.586058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:49.725517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa5cb0-c631-4753-a420-f61d69020574 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:49.730857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd1c14-a31d-4513-9a34-9e1cc9b09e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:49.732136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd1c14-a31d-4513-9a34-9e1cc9b09e71 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:49.732418 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd1c14-a31d-4513-9a34-9e1cc9b09e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:49.732659 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd1c14-a31d-4513-9a34-9e1cc9b09e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:49.733370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd1c14-a31d-4513-9a34-9e1cc9b09e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:49.735922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd1c14-a31d-4513-9a34-9e1cc9b09e71 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:49.867875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1197/2417] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:54:49 2022] POST /identity/v3/projects => generated 367 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:49.868950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae047a2-8d50-42fb-8e0e-c206ff2561b0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:49.888321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae047a2-8d50-42fb-8e0e-c206ff2561b0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:49.980261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5600642-98ea-4e50-817c-6965776792e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:49.981795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600642-98ea-4e50-817c-6965776792e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:49.982342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600642-98ea-4e50-817c-6965776792e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:49.982944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600642-98ea-4e50-817c-6965776792e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:49.983855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5600642-98ea-4e50-817c-6965776792e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:49.986899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5600642-98ea-4e50-817c-6965776792e0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:50.088239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1221/2418] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:54:49 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:50.098447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd1c14-a31d-4513-9a34-9e1cc9b09e71 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:50.107333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:50.123368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd1c14-a31d-4513-9a34-9e1cc9b09e71 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:50.132201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56141093-f003-458f-805b-0090a77f6f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:50.134014 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56141093-f003-458f-805b-0090a77f6f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:50.135090 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56141093-f003-458f-805b-0090a77f6f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:50.135676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56141093-f003-458f-805b-0090a77f6f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:50.136634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56141093-f003-458f-805b-0090a77f6f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:50.139357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56141093-f003-458f-805b-0090a77f6f4e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:50.164868 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1198/2419] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:50.169536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5600642-98ea-4e50-817c-6965776792e0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:50.187773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5600642-98ea-4e50-817c-6965776792e0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:50.209139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32fd03-f885-4092-b47c-cb230f255fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:50.209763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32fd03-f885-4092-b47c-cb230f255fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:50.210045 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32fd03-f885-4092-b47c-cb230f255fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:50.210317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32fd03-f885-4092-b47c-cb230f255fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:50.210975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32fd03-f885-4092-b47c-cb230f255fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:50.212676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32fd03-f885-4092-b47c-cb230f255fc2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:50.243349 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1222/2420] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:54:50.248270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56141093-f003-458f-805b-0090a77f6f4e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:50.261053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56141093-f003-458f-805b-0090a77f6f4e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:50.261842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32fd03-f885-4092-b47c-cb230f255fc2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:50.264246 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2c32fd03-f885-4092-b47c-cb230f255fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:50.268503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed626-7e21-4bb8-b661-13b4b5e554fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:50.269430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed626-7e21-4bb8-b661-13b4b5e554fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:50.269759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed626-7e21-4bb8-b661-13b4b5e554fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:50.269986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed626-7e21-4bb8-b661-13b4b5e554fd admin admin] PATH_INFO: `/v3/projects/cf736d7c345e45f5b2a586d063893093/users/47890ea75cda41718ebe3d875063c958/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:50.289839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32fd03-f885-4092-b47c-cb230f255fc2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:50.320223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:50.320223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:50.320223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:50.320223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] PATH_INFO: `/v3/projects/a9ca7a13ae3e43959972b24c77e0d384` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:50.320863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ca7a13ae3e43959972b24c77e0d384)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:50.320863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:50.321176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aed626-7e21-4bb8-b661-13b4b5e554fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf736d7c345e45f5b2a586d063893093, user_id=47890ea75cda41718ebe3d875063c958, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:50.322893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aed626-7e21-4bb8-b661-13b4b5e554fd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:50.455296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1199/2421] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:54:50 2022] PUT /identity/v3/projects/cf736d7c345e45f5b2a586d063893093/users/47890ea75cda41718ebe3d875063c958/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:50.465950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24ce6-f8f2-445c-b8fc-b86c69900e41 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:50.466252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24ce6-f8f2-445c-b8fc-b86c69900e41 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:50.466515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24ce6-f8f2-445c-b8fc-b86c69900e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:50.514654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-71b24ce6-f8f2-445c-b8fc-b86c69900e41 None None] MFA Rules not processed for user `47890ea75cda41718ebe3d875063c958`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:50.515061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ca7a13ae3e43959972b24c77e0d384', 'request_id': 'req-f22fa64a-419e-4c03-ba15-719441dfa46f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:50.516271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-71b24ce6-f8f2-445c-b8fc-b86c69900e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:50.596121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1200/2422] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:54:50.607799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b24ce6-f8f2-445c-b8fc-b86c69900e41 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:50.609148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-71b24ce6-f8f2-445c-b8fc-b86c69900e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:50.652839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ca7a13ae3e43959972b24c77e0d384', 'request_id': 'req-f22fa64a-419e-4c03-ba15-719441dfa46f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:50.661931 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ca7a13ae3e43959972b24c77e0d384', 'request_id': 'req-f22fa64a-419e-4c03-ba15-719441dfa46f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:50.687079 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] The token cache is being invalidate because project a9ca7a13ae3e43959972b24c77e0d384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:54:50.687501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:50.688265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f22fa64a-419e-4c03-ba15-719441dfa46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:50.689710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b24ce6-f8f2-445c-b8fc-b86c69900e41 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:50.689952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1223/2423] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:54:50 2022] DELETE /identity/v3/projects/a9ca7a13ae3e43959972b24c77e0d384 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:54:50.694756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0f02a-fd6e-4368-ac66-bd66a0fb2e4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:50.695571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1976fb5-0e8e-4253-8bf3-c7fbd6370f3c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:50.695739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0f02a-fd6e-4368-ac66-bd66a0fb2e4a service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:50.695874 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1976fb5-0e8e-4253-8bf3-c7fbd6370f3c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:50.695995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1976fb5-0e8e-4253-8bf3-c7fbd6370f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:50.699811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0f02a-fd6e-4368-ac66-bd66a0fb2e4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:50.700402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0f02a-fd6e-4368-ac66-bd66a0fb2e4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:50.702825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e0a0f02a-fd6e-4368-ac66-bd66a0fb2e4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:50.722336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0f02a-fd6e-4368-ac66-bd66a0fb2e4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:50.729373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0f02a-fd6e-4368-ac66-bd66a0fb2e4a service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:50.733240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-b1976fb5-0e8e-4253-8bf3-c7fbd6370f3c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:50.736623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1201/2424] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:54:50.743526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b1976fb5-0e8e-4253-8bf3-c7fbd6370f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:50.857395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1224/2425] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:54:50.858967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315658ce-66c0-4885-9515-b7ba2a596940 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:50.859468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315658ce-66c0-4885-9515-b7ba2a596940 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:50.859758 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315658ce-66c0-4885-9515-b7ba2a596940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:50.897895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-315658ce-66c0-4885-9515-b7ba2a596940 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:50.899939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-315658ce-66c0-4885-9515-b7ba2a596940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:50.913095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1202/2426] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:50.917423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1976fb5-0e8e-4253-8bf3-c7fbd6370f3c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:50.928859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:50.939559 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1976fb5-0e8e-4253-8bf3-c7fbd6370f3c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:50.948507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a24bfc-0463-42ce-8baf-c8253048dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:50.950013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a24bfc-0463-42ce-8baf-c8253048dc32 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:50.950526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a24bfc-0463-42ce-8baf-c8253048dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:50.950877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a24bfc-0463-42ce-8baf-c8253048dc32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:50.951790 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a24bfc-0463-42ce-8baf-c8253048dc32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:54:50.952219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a24bfc-0463-42ce-8baf-c8253048dc32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:50.954063 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a24bfc-0463-42ce-8baf-c8253048dc32 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:50.967869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1225/2427] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:54:50.972454 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315658ce-66c0-4885-9515-b7ba2a596940 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:50.983602 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315658ce-66c0-4885-9515-b7ba2a596940 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:50.989289 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a8d2e-537f-44a9-92b4-8a8a5e0e0871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:50.991989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a8d2e-537f-44a9-92b4-8a8a5e0e0871 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:50.991989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a8d2e-537f-44a9-92b4-8a8a5e0e0871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:50.991989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a8d2e-537f-44a9-92b4-8a8a5e0e0871 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:50.991989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a8d2e-537f-44a9-92b4-8a8a5e0e0871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:50.995791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a8d2e-537f-44a9-92b4-8a8a5e0e0871 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:51.114503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1203/2428] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:54:50 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:54:51.115656 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a24bfc-0463-42ce-8baf-c8253048dc32 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:51.131018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a24bfc-0463-42ce-8baf-c8253048dc32 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:51.210251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d994f-7118-490f-b1e9-df466771b723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:51.211432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d994f-7118-490f-b1e9-df466771b723 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:51.212411 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d994f-7118-490f-b1e9-df466771b723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:51.212926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d994f-7118-490f-b1e9-df466771b723 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:51.213649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d994f-7118-490f-b1e9-df466771b723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:51.216527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d994f-7118-490f-b1e9-df466771b723 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:51.271373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:51.334993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1226/2429] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:54:51 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:54:51.338956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a8d2e-537f-44a9-92b4-8a8a5e0e0871 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:51.351313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a8d2e-537f-44a9-92b4-8a8a5e0e0871 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:51.357012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c591f-4efa-4208-a45d-695be8dd2d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:51.357742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c591f-4efa-4208-a45d-695be8dd2d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:51.358404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c591f-4efa-4208-a45d-695be8dd2d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:51.358695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c591f-4efa-4208-a45d-695be8dd2d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:51.359435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c591f-4efa-4208-a45d-695be8dd2d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:51.361189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c591f-4efa-4208-a45d-695be8dd2d50 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:51.376066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1204/2430] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:51.377271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d994f-7118-490f-b1e9-df466771b723 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:51.392340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d994f-7118-490f-b1e9-df466771b723 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:51.397926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c825b0-60f3-47ce-a53f-fa6a43caec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:51.398651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c825b0-60f3-47ce-a53f-fa6a43caec41 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:51.399033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c825b0-60f3-47ce-a53f-fa6a43caec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:51.399352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c825b0-60f3-47ce-a53f-fa6a43caec41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:51.400146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c825b0-60f3-47ce-a53f-fa6a43caec41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:51.402112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c825b0-60f3-47ce-a53f-fa6a43caec41 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:51.415119 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1227/2431] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:54:51.418811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c591f-4efa-4208-a45d-695be8dd2d50 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:51.430229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c591f-4efa-4208-a45d-695be8dd2d50 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:51.434937 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c95e9-8ecb-49a6-bc8e-baf6b09c8668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:51.435667 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c95e9-8ecb-49a6-bc8e-baf6b09c8668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:51.437040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c95e9-8ecb-49a6-bc8e-baf6b09c8668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:51.437040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c95e9-8ecb-49a6-bc8e-baf6b09c8668 admin admin] PATH_INFO: `/v3/projects/a7656cdb1b03423a8388cb52c82052c7/users/46fba300a0e942a0978221fe8f8b8bfc/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:51.457760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c95e9-8ecb-49a6-bc8e-baf6b09c8668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7656cdb1b03423a8388cb52c82052c7, user_id=46fba300a0e942a0978221fe8f8b8bfc, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:51.460633 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c95e9-8ecb-49a6-bc8e-baf6b09c8668 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:51.594249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1205/2432] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:54:51 2022] PUT /identity/v3/projects/a7656cdb1b03423a8388cb52c82052c7/users/46fba300a0e942a0978221fe8f8b8bfc/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:54:51.596222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa174-b219-4694-b3fd-74f950a07ee0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:51.596725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa174-b219-4694-b3fd-74f950a07ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:51.597182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa174-b219-4694-b3fd-74f950a07ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:51.645353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2c2fa174-b219-4694-b3fd-74f950a07ee0 None None] MFA Rules not processed for user `46fba300a0e942a0978221fe8f8b8bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:51.646999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2c2fa174-b219-4694-b3fd-74f950a07ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:51.801665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1228/2433] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:54:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:51.815756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c95e9-8ecb-49a6-bc8e-baf6b09c8668 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:51.817815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ac4c95e9-8ecb-49a6-bc8e-baf6b09c8668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:51.967879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c95e9-8ecb-49a6-bc8e-baf6b09c8668 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:51.977100 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0ea62-db04-4e19-bade-ea658f80691c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6955fc5b81a040f686e21621ea968a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:51.978072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0ea62-db04-4e19-bade-ea658f80691c service glance] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:51.978586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0ea62-db04-4e19-bade-ea658f80691c service glance] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:51.979179 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0ea62-db04-4e19-bade-ea658f80691c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:52.010421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0ea62-db04-4e19-bade-ea658f80691c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:52.014165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0ea62-db04-4e19-bade-ea658f80691c service glance] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:52.036502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1206/2434] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:54:56.763917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfed5b3-d608-48a2-94c9-2791b095f9f0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:56.768662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfed5b3-d608-48a2-94c9-2791b095f9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:56.768662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfed5b3-d608-48a2-94c9-2791b095f9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:56.814105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4cfed5b3-d608-48a2-94c9-2791b095f9f0 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:56.814637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4cfed5b3-d608-48a2-94c9-2791b095f9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:56.891106 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:56.919730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1229/2435] 10.222.0.93 () {58 vars in 1016 bytes} [Wed Aug 24 03:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:56.945332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0ea62-db04-4e19-bade-ea658f80691c service glance] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:56.946796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-48a0ea62-db04-4e19-bade-ea658f80691c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:57.031934 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0ea62-db04-4e19-bade-ea658f80691c service glance] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:57.037855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd62e8-48a8-4da5-b27c-8e2bc149d39e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:57.038575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd62e8-48a8-4da5-b27c-8e2bc149d39e service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:57.038874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd62e8-48a8-4da5-b27c-8e2bc149d39e service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:57.039094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd62e8-48a8-4da5-b27c-8e2bc149d39e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:57.047986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd62e8-48a8-4da5-b27c-8e2bc149d39e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:57.049623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd62e8-48a8-4da5-b27c-8e2bc149d39e service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:57.060614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1207/2436] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:00.548133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d02f8-6dd4-4c16-9d5d-82e790fbb1d8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:00.548611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d02f8-6dd4-4c16-9d5d-82e790fbb1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:00.548811 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d02f8-6dd4-4c16-9d5d-82e790fbb1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:00.569033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-312d02f8-6dd4-4c16-9d5d-82e790fbb1d8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:00.570280 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-312d02f8-6dd4-4c16-9d5d-82e790fbb1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:00.578829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1230/2437] 10.222.0.93 () {58 vars in 1016 bytes} [Wed Aug 24 03:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:00.602078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd62e8-48a8-4da5-b27c-8e2bc149d39e service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:00.614889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd62e8-48a8-4da5-b27c-8e2bc149d39e service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:00.620711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc566c-7e0a-4fe7-8dcf-91faaef5c434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:00.621318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc566c-7e0a-4fe7-8dcf-91faaef5c434 service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:00.622239 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc566c-7e0a-4fe7-8dcf-91faaef5c434 service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:00.622552 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc566c-7e0a-4fe7-8dcf-91faaef5c434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:00.631368 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc566c-7e0a-4fe7-8dcf-91faaef5c434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:00.633222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc566c-7e0a-4fe7-8dcf-91faaef5c434 service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:00.645134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1208/2438] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:01.852854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d02f8-6dd4-4c16-9d5d-82e790fbb1d8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:01.854331 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-312d02f8-6dd4-4c16-9d5d-82e790fbb1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:01.870600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d02f8-6dd4-4c16-9d5d-82e790fbb1d8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:01.884654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:01.884654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:01.884654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:01.884654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] PATH_INFO: `/v3/users/47890ea75cda41718ebe3d875063c958` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:01.885700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47890ea75cda41718ebe3d875063c958)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:01.885700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:02.129923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47890ea75cda41718ebe3d875063c958'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:02.130680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47890ea75cda41718ebe3d875063c958'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:02.131329 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47890ea75cda41718ebe3d875063c958'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:02.218687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47890ea75cda41718ebe3d875063c958'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:02.233570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47890ea75cda41718ebe3d875063c958'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:02.246373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1231/2439] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:01 2022] DELETE /identity/v3/users/47890ea75cda41718ebe3d875063c958 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:02.251737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702d4cd-fafd-4768-b835-054f09c5dc87 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:02.252256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702d4cd-fafd-4768-b835-054f09c5dc87 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:02.252378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702d4cd-fafd-4768-b835-054f09c5dc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:02.272476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3702d4cd-fafd-4768-b835-054f09c5dc87 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:02.273719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3702d4cd-fafd-4768-b835-054f09c5dc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:02.284777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:02.339984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1209/2440] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:02.350169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:02.354710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:02.421332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26f59e-c53f-4a68-9ea4-f1fbe1221626 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:02.424945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef053d-a9ed-4fbb-94a1-b9233671b48e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:02.425558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef053d-a9ed-4fbb-94a1-b9233671b48e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:02.425841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef053d-a9ed-4fbb-94a1-b9233671b48e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:02.426117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef053d-a9ed-4fbb-94a1-b9233671b48e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:02.435075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef053d-a9ed-4fbb-94a1-b9233671b48e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:02.436533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef053d-a9ed-4fbb-94a1-b9233671b48e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:02.446628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1232/2441] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:02.979290 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702d4cd-fafd-4768-b835-054f09c5dc87 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:02.982703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3702d4cd-fafd-4768-b835-054f09c5dc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:02.998967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702d4cd-fafd-4768-b835-054f09c5dc87 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:03.009487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:03.010248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:03.010542 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:03.010895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] PATH_INFO: `/v3/projects/cf736d7c345e45f5b2a586d063893093` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:03.012775 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf736d7c345e45f5b2a586d063893093)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:03.015843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:03.162544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf736d7c345e45f5b2a586d063893093', 'request_id': 'req-d47350c7-20cb-46cc-b3aa-8818c39733a3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:03.169488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf736d7c345e45f5b2a586d063893093', 'request_id': 'req-d47350c7-20cb-46cc-b3aa-8818c39733a3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:03.269653 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf736d7c345e45f5b2a586d063893093', 'request_id': 'req-d47350c7-20cb-46cc-b3aa-8818c39733a3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:03.282501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] The token cache is being invalidate because project cf736d7c345e45f5b2a586d063893093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:03.282995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:03.283708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d47350c7-20cb-46cc-b3aa-8818c39733a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:03.285347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1210/2442] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:02 2022] DELETE /identity/v3/projects/cf736d7c345e45f5b2a586d063893093 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:03.290238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8956454-d585-4e12-a10f-299f3d48e866 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:03.290718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8956454-d585-4e12-a10f-299f3d48e866 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:03.290819 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8956454-d585-4e12-a10f-299f3d48e866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:03.313708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-d8956454-d585-4e12-a10f-299f3d48e866 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:03.314966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d8956454-d585-4e12-a10f-299f3d48e866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:03.366721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:03.386050 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1233/2443] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:03.394031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36670db-d756-4093-9894-d7a0ad49d476 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:03.394398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36670db-d756-4093-9894-d7a0ad49d476 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:03.394590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36670db-d756-4093-9894-d7a0ad49d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:03.417719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e36670db-d756-4093-9894-d7a0ad49d476 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:03.419594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e36670db-d756-4093-9894-d7a0ad49d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:03.434981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1211/2444] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:03.440140 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8956454-d585-4e12-a10f-299f3d48e866 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:03.460326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8956454-d585-4e12-a10f-299f3d48e866 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:03.471869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41aecb2-047c-4fa3-9883-e0206c6dae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:03.472564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aecb2-047c-4fa3-9883-e0206c6dae12 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:03.474092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aecb2-047c-4fa3-9883-e0206c6dae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:03.474092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aecb2-047c-4fa3-9883-e0206c6dae12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:03.474092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41aecb2-047c-4fa3-9883-e0206c6dae12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:03.474746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41aecb2-047c-4fa3-9883-e0206c6dae12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:03.476462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41aecb2-047c-4fa3-9883-e0206c6dae12 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:03.491483 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1234/2445] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:55:03.495990 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36670db-d756-4093-9894-d7a0ad49d476 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:03.505817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36670db-d756-4093-9894-d7a0ad49d476 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:03.510600 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb284279-d969-4f9f-8136-14ae1fc48f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:03.511412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb284279-d969-4f9f-8136-14ae1fc48f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:03.511732 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb284279-d969-4f9f-8136-14ae1fc48f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:03.512601 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb284279-d969-4f9f-8136-14ae1fc48f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:03.513291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb284279-d969-4f9f-8136-14ae1fc48f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:03.515372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb284279-d969-4f9f-8136-14ae1fc48f03 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:03.670098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1212/2446] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:03 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:03.674859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41aecb2-047c-4fa3-9883-e0206c6dae12 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:03.686669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41aecb2-047c-4fa3-9883-e0206c6dae12 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:03.764522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481065-ad6c-4690-a664-40c70385169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:03.765273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481065-ad6c-4690-a664-40c70385169a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:03.771204 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481065-ad6c-4690-a664-40c70385169a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:03.771204 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481065-ad6c-4690-a664-40c70385169a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:03.771204 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad481065-ad6c-4690-a664-40c70385169a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:03.775496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad481065-ad6c-4690-a664-40c70385169a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:03.913657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1235/2447] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:03 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:03.918020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb284279-d969-4f9f-8136-14ae1fc48f03 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:03.929423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb284279-d969-4f9f-8136-14ae1fc48f03 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:03.934484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748e477-0ad1-4b44-bd85-861f2d952e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:03.935209 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748e477-0ad1-4b44-bd85-861f2d952e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:03.937375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748e477-0ad1-4b44-bd85-861f2d952e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:03.937375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748e477-0ad1-4b44-bd85-861f2d952e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:03.937375 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748e477-0ad1-4b44-bd85-861f2d952e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:03.938227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748e477-0ad1-4b44-bd85-861f2d952e72 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:03.951173 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1213/2448] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:03.955416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481065-ad6c-4690-a664-40c70385169a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:03.966395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481065-ad6c-4690-a664-40c70385169a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:03.971236 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d927e7-2153-41ad-ac68-628d3283bde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:03.971843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d927e7-2153-41ad-ac68-628d3283bde3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:03.972128 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d927e7-2153-41ad-ac68-628d3283bde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:03.972405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d927e7-2153-41ad-ac68-628d3283bde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:03.973122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d927e7-2153-41ad-ac68-628d3283bde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:03.974730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d927e7-2153-41ad-ac68-628d3283bde3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:03.986915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1236/2449] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:03.991234 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748e477-0ad1-4b44-bd85-861f2d952e72 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:04.001370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748e477-0ad1-4b44-bd85-861f2d952e72 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:04.006013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aac4bd-5025-4d54-816e-f331b6ff141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:04.006700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac4bd-5025-4d54-816e-f331b6ff141e admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:04.006980 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac4bd-5025-4d54-816e-f331b6ff141e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:04.007299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac4bd-5025-4d54-816e-f331b6ff141e admin admin] PATH_INFO: `/v3/projects/66291d4a5a414709bb659403fc002caf/users/402e679db4584bdb85cc01ca7541de5f/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:04.022061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aac4bd-5025-4d54-816e-f331b6ff141e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66291d4a5a414709bb659403fc002caf, user_id=402e679db4584bdb85cc01ca7541de5f, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:04.025562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aac4bd-5025-4d54-816e-f331b6ff141e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:04.127268 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1214/2450] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:03 2022] PUT /identity/v3/projects/66291d4a5a414709bb659403fc002caf/users/402e679db4584bdb85cc01ca7541de5f/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:04.138176 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bceda-456a-4b79-a9b2-327c701cdbe9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:04.138460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bceda-456a-4b79-a9b2-327c701cdbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:04.138736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bceda-456a-4b79-a9b2-327c701cdbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:04.167321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1b1bceda-456a-4b79-a9b2-327c701cdbe9 None None] MFA Rules not processed for user `402e679db4584bdb85cc01ca7541de5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:04.168577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1b1bceda-456a-4b79-a9b2-327c701cdbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:04.256044 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1237/2451] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:04.260626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aac4bd-5025-4d54-816e-f331b6ff141e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:04.304950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:04.329352 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aac4bd-5025-4d54-816e-f331b6ff141e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:04.334293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f263c-d020-412a-ae55-cbd66656f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:04.334913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f263c-d020-412a-ae55-cbd66656f2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:04.335239 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f263c-d020-412a-ae55-cbd66656f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:04.335516 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f263c-d020-412a-ae55-cbd66656f2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:04.336149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f263c-d020-412a-ae55-cbd66656f2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:04.338071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f263c-d020-412a-ae55-cbd66656f2a2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:04.473566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1215/2452] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:04 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:04.477826 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bceda-456a-4b79-a9b2-327c701cdbe9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:04.490457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bceda-456a-4b79-a9b2-327c701cdbe9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:04.545433 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:04.632678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4509-dc6c-44f5-a882-dbd49e34e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:04.632678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4509-dc6c-44f5-a882-dbd49e34e971 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:04.632678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4509-dc6c-44f5-a882-dbd49e34e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:04.632678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4509-dc6c-44f5-a882-dbd49e34e971 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:04.634234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce4509-dc6c-44f5-a882-dbd49e34e971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:04.634234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce4509-dc6c-44f5-a882-dbd49e34e971 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:04.984061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99c36a-96eb-4f83-bc16-833d37f2be7e None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:04.984624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99c36a-96eb-4f83-bc16-833d37f2be7e None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:04.985001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99c36a-96eb-4f83-bc16-833d37f2be7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:05.011621 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-eb99c36a-96eb-4f83-bc16-833d37f2be7e None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:05.013531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-eb99c36a-96eb-4f83-bc16-833d37f2be7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:05.091211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1216/2453] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 03:55:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:05.104555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99c36a-96eb-4f83-bc16-833d37f2be7e None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:05.107078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-eb99c36a-96eb-4f83-bc16-833d37f2be7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:05.201224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99c36a-96eb-4f83-bc16-833d37f2be7e None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:05.208550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb41e76-a45d-481a-8ddd-7c8f1a49969f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:05.209312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41e76-a45d-481a-8ddd-7c8f1a49969f service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:05.209598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41e76-a45d-481a-8ddd-7c8f1a49969f service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:05.211959 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb41e76-a45d-481a-8ddd-7c8f1a49969f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:05.223431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb41e76-a45d-481a-8ddd-7c8f1a49969f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:05.225091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb41e76-a45d-481a-8ddd-7c8f1a49969f service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:05.234563 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1217/2454] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:55:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:55:05.311027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1238/2455] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:04 2022] POST /identity/v3/users => generated 293 bytes in 834 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:05.315325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb41e76-a45d-481a-8ddd-7c8f1a49969f service swift] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:05.326495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb41e76-a45d-481a-8ddd-7c8f1a49969f service swift] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:05.333218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76743aed-8381-4769-a45d-51bfec4811c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:05.333900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76743aed-8381-4769-a45d-51bfec4811c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:05.334253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76743aed-8381-4769-a45d-51bfec4811c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:05.334584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76743aed-8381-4769-a45d-51bfec4811c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:05.335123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76743aed-8381-4769-a45d-51bfec4811c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:05.336744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76743aed-8381-4769-a45d-51bfec4811c7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:05.348559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1218/2456] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:05.352807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4509-dc6c-44f5-a882-dbd49e34e971 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:05.363990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4509-dc6c-44f5-a882-dbd49e34e971 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:05.368732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc63b3-d3f8-48e1-b011-ed62779d09a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:05.369391 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc63b3-d3f8-48e1-b011-ed62779d09a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:05.369679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc63b3-d3f8-48e1-b011-ed62779d09a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:05.369962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc63b3-d3f8-48e1-b011-ed62779d09a2 admin admin] PATH_INFO: `/v3/projects/1bef4cdd29ca49b3a06d9828ef191fb1/users/f284aaa062f94e0283e08ac384b75bfb/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:05.384956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc63b3-d3f8-48e1-b011-ed62779d09a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bef4cdd29ca49b3a06d9828ef191fb1, user_id=f284aaa062f94e0283e08ac384b75bfb, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:05.387928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc63b3-d3f8-48e1-b011-ed62779d09a2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:05.513649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1239/2457] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:05 2022] PUT /identity/v3/projects/1bef4cdd29ca49b3a06d9828ef191fb1/users/f284aaa062f94e0283e08ac384b75bfb/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:05.516718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76743aed-8381-4769-a45d-51bfec4811c7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:05.528927 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76743aed-8381-4769-a45d-51bfec4811c7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:05.576698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:05.606494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20dca4-9190-47cc-83d2-160b499ddd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:05.606494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20dca4-9190-47cc-83d2-160b499ddd06 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:05.606494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20dca4-9190-47cc-83d2-160b499ddd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:05.606494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20dca4-9190-47cc-83d2-160b499ddd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:05.606995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20dca4-9190-47cc-83d2-160b499ddd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:05.606995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20dca4-9190-47cc-83d2-160b499ddd06 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:05.636311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1219/2458] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:05.641076 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc63b3-d3f8-48e1-b011-ed62779d09a2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:05.653501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc63b3-d3f8-48e1-b011-ed62779d09a2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:05.658765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53565a3-2aea-4b40-93d0-a96bf1a2893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:05.659512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53565a3-2aea-4b40-93d0-a96bf1a2893b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:05.659909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53565a3-2aea-4b40-93d0-a96bf1a2893b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:05.660093 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53565a3-2aea-4b40-93d0-a96bf1a2893b admin admin] PATH_INFO: `/v3/projects/1bef4cdd29ca49b3a06d9828ef191fb1/users/f284aaa062f94e0283e08ac384b75bfb/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:05.665484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53565a3-2aea-4b40-93d0-a96bf1a2893b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bef4cdd29ca49b3a06d9828ef191fb1, user_id=f284aaa062f94e0283e08ac384b75bfb, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:05.668581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53565a3-2aea-4b40-93d0-a96bf1a2893b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:05.681004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1240/2459] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:05 2022] PUT /identity/v3/projects/1bef4cdd29ca49b3a06d9828ef191fb1/users/f284aaa062f94e0283e08ac384b75bfb/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:05.696997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a8b81-a6a4-4eeb-8a2c-59556667638a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:05.697288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a8b81-a6a4-4eeb-8a2c-59556667638a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:05.697570 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a8b81-a6a4-4eeb-8a2c-59556667638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:05.737894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-981a8b81-a6a4-4eeb-8a2c-59556667638a None None] MFA Rules not processed for user `f284aaa062f94e0283e08ac384b75bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:05.739142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-981a8b81-a6a4-4eeb-8a2c-59556667638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:05.823333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1220/2460] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:05.849731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53565a3-2aea-4b40-93d0-a96bf1a2893b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:05.849731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b53565a3-2aea-4b40-93d0-a96bf1a2893b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:05.907769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53565a3-2aea-4b40-93d0-a96bf1a2893b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:05.916739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e3856-ae6b-4c31-b488-70a567c51681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:05.919695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3856-ae6b-4c31-b488-70a567c51681 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:05.919695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3856-ae6b-4c31-b488-70a567c51681 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:05.919695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e3856-ae6b-4c31-b488-70a567c51681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:05.928965 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e3856-ae6b-4c31-b488-70a567c51681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:05.930428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e3856-ae6b-4c31-b488-70a567c51681 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:05.940496 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1241/2461] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:05.958485 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ab66e-7d22-4da7-a03e-8206b6c9be5b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:05.958789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ab66e-7d22-4da7-a03e-8206b6c9be5b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:05.959082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ab66e-7d22-4da7-a03e-8206b6c9be5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:05.981705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-773ab66e-7d22-4da7-a03e-8206b6c9be5b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:05.983202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-773ab66e-7d22-4da7-a03e-8206b6c9be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:06.053998 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1221/2462] 10.222.0.93 () {58 vars in 1016 bytes} [Wed Aug 24 03:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:06.082143 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e3856-ae6b-4c31-b488-70a567c51681 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:06.083575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e04e3856-ae6b-4c31-b488-70a567c51681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:06.167337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e3856-ae6b-4c31-b488-70a567c51681 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:06.183315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4af1e-0f94-4659-8244-845146989c50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:06.184454 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4af1e-0f94-4659-8244-845146989c50 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:06.184736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4af1e-0f94-4659-8244-845146989c50 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:06.185007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4af1e-0f94-4659-8244-845146989c50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:06.199315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4af1e-0f94-4659-8244-845146989c50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:06.203444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4af1e-0f94-4659-8244-845146989c50 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:06.217759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1242/2463] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:07.058939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868ce8-999f-4ab7-b5c0-309808d06f13 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:07.059469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868ce8-999f-4ab7-b5c0-309808d06f13 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:07.062900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868ce8-999f-4ab7-b5c0-309808d06f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:07.078684 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ff868ce8-999f-4ab7-b5c0-309808d06f13 None None] MFA Rules not processed for user `d33c67fc513e49df9f6792475ff2d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:07.079922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ff868ce8-999f-4ab7-b5c0-309808d06f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:07.133266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4af1e-0f94-4659-8244-845146989c50 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:07.137823 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1222/2464] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 03:55:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:07.144028 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4af1e-0f94-4659-8244-845146989c50 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:07.148968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:07.149661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:07.149944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:07.150221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] PATH_INFO: `/v3/users/402e679db4584bdb85cc01ca7541de5f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:07.150378 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff868ce8-999f-4ab7-b5c0-309808d06f13 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:07.151523 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=402e679db4584bdb85cc01ca7541de5f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:07.154069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:07.164648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:07.181812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:07.221707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff868ce8-999f-4ab7-b5c0-309808d06f13 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:07.226866 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcc8ae-e0dc-400d-9ea1-a76305afb8f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4052d31496a46948211cd4b7d38808b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:07.227528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc8ae-e0dc-400d-9ea1-a76305afb8f9 service swift] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:07.227814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc8ae-e0dc-400d-9ea1-a76305afb8f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:07.228094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc8ae-e0dc-400d-9ea1-a76305afb8f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:07.236115 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcc8ae-e0dc-400d-9ea1-a76305afb8f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:07.237740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcc8ae-e0dc-400d-9ea1-a76305afb8f9 service swift] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:07.246451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1223/2465] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 03:55:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:55:07.382801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '402e679db4584bdb85cc01ca7541de5f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:07.384408 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '402e679db4584bdb85cc01ca7541de5f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:07.384976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '402e679db4584bdb85cc01ca7541de5f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:07.458715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '402e679db4584bdb85cc01ca7541de5f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:07.472841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '402e679db4584bdb85cc01ca7541de5f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:07.485202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1243/2466] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:07 2022] DELETE /identity/v3/users/402e679db4584bdb85cc01ca7541de5f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:07.489649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a1e6-02a9-4f78-a8a3-ba41073cf272 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:07.490005 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a1e6-02a9-4f78-a8a3-ba41073cf272 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:07.490356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000a1e6-02a9-4f78-a8a3-ba41073cf272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:07.510207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d000a1e6-02a9-4f78-a8a3-ba41073cf272 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:07.511442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d000a1e6-02a9-4f78-a8a3-ba41073cf272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:07.589331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1224/2467] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:07.602018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:07.603657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:07.665712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a4cac-7a36-4ed0-b7d8-0bc304a6fe32 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:07.669470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714235-6b28-408a-af97-f36a1071e0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:07.673944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714235-6b28-408a-af97-f36a1071e0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:07.673944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714235-6b28-408a-af97-f36a1071e0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:07.673944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714235-6b28-408a-af97-f36a1071e0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:07.680264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714235-6b28-408a-af97-f36a1071e0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:07.681735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714235-6b28-408a-af97-f36a1071e0d2 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:07.692041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1244/2468] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:08.127938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000a1e6-02a9-4f78-a8a3-ba41073cf272 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:08.129526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d000a1e6-02a9-4f78-a8a3-ba41073cf272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:08.141366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000a1e6-02a9-4f78-a8a3-ba41073cf272 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:08.147188 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:08.147911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:08.148298 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:08.148468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] PATH_INFO: `/v3/projects/66291d4a5a414709bb659403fc002caf` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:08.149938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66291d4a5a414709bb659403fc002caf)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:08.164853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:08.270701 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66291d4a5a414709bb659403fc002caf', 'request_id': 'req-d550f977-b96f-4339-89bf-f40df98e89a0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:08.276244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66291d4a5a414709bb659403fc002caf', 'request_id': 'req-d550f977-b96f-4339-89bf-f40df98e89a0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:08.338252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66291d4a5a414709bb659403fc002caf', 'request_id': 'req-d550f977-b96f-4339-89bf-f40df98e89a0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:08.350562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] The token cache is being invalidate because project 66291d4a5a414709bb659403fc002caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:08.350860 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:08.351528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:08.353042 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1225/2469] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:08 2022] DELETE /identity/v3/projects/66291d4a5a414709bb659403fc002caf => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:08.357719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714235-6b28-408a-af97-f36a1071e0d2 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:08.368869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714235-6b28-408a-af97-f36a1071e0d2 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:08.427565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091c819-ea7a-4e65-82d1-34d5f813456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:08.428248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091c819-ea7a-4e65-82d1-34d5f813456d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:08.428528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091c819-ea7a-4e65-82d1-34d5f813456d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:08.428803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091c819-ea7a-4e65-82d1-34d5f813456d admin admin] PATH_INFO: `/v3/users/f284aaa062f94e0283e08ac384b75bfb` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:08.430050 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091c819-ea7a-4e65-82d1-34d5f813456d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f284aaa062f94e0283e08ac384b75bfb)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:08.432064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091c819-ea7a-4e65-82d1-34d5f813456d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:08.689317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:08.698239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d091c819-ea7a-4e65-82d1-34d5f813456d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f284aaa062f94e0283e08ac384b75bfb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:08.699618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d091c819-ea7a-4e65-82d1-34d5f813456d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f284aaa062f94e0283e08ac384b75bfb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:08.704637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d091c819-ea7a-4e65-82d1-34d5f813456d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f284aaa062f94e0283e08ac384b75bfb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:08.807336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d091c819-ea7a-4e65-82d1-34d5f813456d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f284aaa062f94e0283e08ac384b75bfb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:08.821061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d091c819-ea7a-4e65-82d1-34d5f813456d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f284aaa062f94e0283e08ac384b75bfb'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:08.835590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1245/2470] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:08 2022] DELETE /identity/v3/users/f284aaa062f94e0283e08ac384b75bfb => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:09.326203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:09.334255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:09.354696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550f977-b96f-4339-89bf-f40df98e89a0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:09.408261 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:09.490962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:09.491649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:09.491935 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:09.492211 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] PATH_INFO: `/v3/projects/1bef4cdd29ca49b3a06d9828ef191fb1` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:09.493552 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bef4cdd29ca49b3a06d9828ef191fb1)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:09.495535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:09.636660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bef4cdd29ca49b3a06d9828ef191fb1', 'request_id': 'req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:09.642270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bef4cdd29ca49b3a06d9828ef191fb1', 'request_id': 'req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:09.790151 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bef4cdd29ca49b3a06d9828ef191fb1', 'request_id': 'req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:09.808200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] The token cache is being invalidate because project 1bef4cdd29ca49b3a06d9828ef191fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:09.808786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:09.809997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-317e8ad4-fd5a-4f67-9eb0-e2fa81221a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:09.817746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ac6bc-98dc-4203-8447-55588f28d4a8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:09.818279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ac6bc-98dc-4203-8447-55588f28d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:09.818856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ac6bc-98dc-4203-8447-55588f28d4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:09.823318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1226/2471] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:09 2022] DELETE /identity/v3/projects/1bef4cdd29ca49b3a06d9828ef191fb1 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:09.844021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-150ac6bc-98dc-4203-8447-55588f28d4a8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:09.848386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-150ac6bc-98dc-4203-8447-55588f28d4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:09.974549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1246/2472] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:09.982389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aedbd-9285-4127-beac-c950755b5889 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:09.982903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aedbd-9285-4127-beac-c950755b5889 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:09.983358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aedbd-9285-4127-beac-c950755b5889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:10.010429 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bc2aedbd-9285-4127-beac-c950755b5889 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:10.012274 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bc2aedbd-9285-4127-beac-c950755b5889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:10.026312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1227/2473] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:10.038164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ac6bc-98dc-4203-8447-55588f28d4a8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:10.049782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ac6bc-98dc-4203-8447-55588f28d4a8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:10.054487 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164d330-389c-4368-a2ce-a8e9b1ace636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:10.055205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164d330-389c-4368-a2ce-a8e9b1ace636 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:10.055480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164d330-389c-4368-a2ce-a8e9b1ace636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:10.055771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164d330-389c-4368-a2ce-a8e9b1ace636 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:10.056672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164d330-389c-4368-a2ce-a8e9b1ace636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:10.060041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164d330-389c-4368-a2ce-a8e9b1ace636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:10.060041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164d330-389c-4368-a2ce-a8e9b1ace636 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:10.071389 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1247/2474] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:55:10.077154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aedbd-9285-4127-beac-c950755b5889 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:10.089042 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aedbd-9285-4127-beac-c950755b5889 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:10.094548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf3462-86a0-48ed-a7b5-64e182f3a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:10.095618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3462-86a0-48ed-a7b5-64e182f3a37e admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:10.095618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3462-86a0-48ed-a7b5-64e182f3a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:10.095830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf3462-86a0-48ed-a7b5-64e182f3a37e admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:10.096615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf3462-86a0-48ed-a7b5-64e182f3a37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:10.098631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf3462-86a0-48ed-a7b5-64e182f3a37e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:10.219604 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1228/2475] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:10 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:10.223984 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164d330-389c-4368-a2ce-a8e9b1ace636 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:10.237205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164d330-389c-4368-a2ce-a8e9b1ace636 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:10.346027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5534b-0939-4f80-a16e-02d3b73836a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:10.346600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5534b-0939-4f80-a16e-02d3b73836a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:10.346883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5534b-0939-4f80-a16e-02d3b73836a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:10.347380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5534b-0939-4f80-a16e-02d3b73836a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:10.348714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5534b-0939-4f80-a16e-02d3b73836a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:10.351466 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5534b-0939-4f80-a16e-02d3b73836a0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:10.442774 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1248/2476] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:10 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:10.443013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf3462-86a0-48ed-a7b5-64e182f3a37e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:10.454453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf3462-86a0-48ed-a7b5-64e182f3a37e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:10.460194 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bf40a-0ece-491d-a80d-7a8a101a3f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:10.460934 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf40a-0ece-491d-a80d-7a8a101a3f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:10.461287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf40a-0ece-491d-a80d-7a8a101a3f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:10.462371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf40a-0ece-491d-a80d-7a8a101a3f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:10.463252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bf40a-0ece-491d-a80d-7a8a101a3f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:10.465439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bf40a-0ece-491d-a80d-7a8a101a3f3f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:10.481692 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1229/2477] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:10.487268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5534b-0939-4f80-a16e-02d3b73836a0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:10.499205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5534b-0939-4f80-a16e-02d3b73836a0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:10.506257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c91af8-04dc-4d4f-821d-aa0fd34e773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:10.508740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91af8-04dc-4d4f-821d-aa0fd34e773c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:10.509502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91af8-04dc-4d4f-821d-aa0fd34e773c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:10.509993 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91af8-04dc-4d4f-821d-aa0fd34e773c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:10.511219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c91af8-04dc-4d4f-821d-aa0fd34e773c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:10.513824 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c91af8-04dc-4d4f-821d-aa0fd34e773c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:10.545498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bf40a-0ece-491d-a80d-7a8a101a3f3f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:10.547063 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1249/2478] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:10.557220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bf40a-0ece-491d-a80d-7a8a101a3f3f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:10.564060 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2137b6-08f0-461f-a572-cefa55ae0819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:10.565686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2137b6-08f0-461f-a572-cefa55ae0819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:10.566333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2137b6-08f0-461f-a572-cefa55ae0819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:10.566887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2137b6-08f0-461f-a572-cefa55ae0819 admin admin] PATH_INFO: `/v3/projects/c4bf7860b5034559b1cbb99bf9e363b8/users/74afc8b7e73441afa5972ddab17d43f2/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:10.587435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2137b6-08f0-461f-a572-cefa55ae0819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bf7860b5034559b1cbb99bf9e363b8, user_id=74afc8b7e73441afa5972ddab17d43f2, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:10.591325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2137b6-08f0-461f-a572-cefa55ae0819 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:10.695725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1230/2479] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:10 2022] PUT /identity/v3/projects/c4bf7860b5034559b1cbb99bf9e363b8/users/74afc8b7e73441afa5972ddab17d43f2/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:10.707728 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86d3e4-6442-4d32-8cf2-05d5aa1ca117 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:10.708561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86d3e4-6442-4d32-8cf2-05d5aa1ca117 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:10.708561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86d3e4-6442-4d32-8cf2-05d5aa1ca117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:10.769012 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-bf86d3e4-6442-4d32-8cf2-05d5aa1ca117 None None] MFA Rules not processed for user `74afc8b7e73441afa5972ddab17d43f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:10.771165 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bf86d3e4-6442-4d32-8cf2-05d5aa1ca117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:10.788583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:10.874896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1250/2480] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:10.880101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2137b6-08f0-461f-a572-cefa55ae0819 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:10.960811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:10.977354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2137b6-08f0-461f-a572-cefa55ae0819 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:10.985118 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c6586-3c8d-4f21-ac61-5c98523feefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:10.985837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6586-3c8d-4f21-ac61-5c98523feefd admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:10.986573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6586-3c8d-4f21-ac61-5c98523feefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:10.986573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6586-3c8d-4f21-ac61-5c98523feefd admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:10.987005 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c6586-3c8d-4f21-ac61-5c98523feefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:10.989152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c6586-3c8d-4f21-ac61-5c98523feefd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:11.121837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1231/2481] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:10 2022] POST /identity/v3/projects => generated 365 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:11.126588 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86d3e4-6442-4d32-8cf2-05d5aa1ca117 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:11.141564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86d3e4-6442-4d32-8cf2-05d5aa1ca117 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:11.220975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26364eff-7ed8-4790-b79a-b55306149eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:11.221832 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26364eff-7ed8-4790-b79a-b55306149eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:11.222190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26364eff-7ed8-4790-b79a-b55306149eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:11.222664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26364eff-7ed8-4790-b79a-b55306149eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:11.223939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26364eff-7ed8-4790-b79a-b55306149eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:11.226084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26364eff-7ed8-4790-b79a-b55306149eb8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:11.376667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1251/2482] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:11 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:11.378048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c6586-3c8d-4f21-ac61-5c98523feefd admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:11.397892 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c6586-3c8d-4f21-ac61-5c98523feefd admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:11.411175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61a0ce-6ec8-4ba8-880b-fcb657f3fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:11.411742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a0ce-6ec8-4ba8-880b-fcb657f3fb57 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:11.412027 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a0ce-6ec8-4ba8-880b-fcb657f3fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:11.412304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a0ce-6ec8-4ba8-880b-fcb657f3fb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:11.412961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61a0ce-6ec8-4ba8-880b-fcb657f3fb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:11.414586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61a0ce-6ec8-4ba8-880b-fcb657f3fb57 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:11.426219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1232/2483] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:11.430582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26364eff-7ed8-4790-b79a-b55306149eb8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:11.442502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26364eff-7ed8-4790-b79a-b55306149eb8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:11.447302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a950-5255-4e06-b5c8-1199f928c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:11.447972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a950-5255-4e06-b5c8-1199f928c359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:11.448264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a950-5255-4e06-b5c8-1199f928c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:11.448545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a950-5255-4e06-b5c8-1199f928c359 admin admin] PATH_INFO: `/v3/projects/22308e7decc74c07ab16bd8a5d29335f/users/05ef8ca1f3b24c1fa72de61b6466db57/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:11.468682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4a950-5255-4e06-b5c8-1199f928c359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22308e7decc74c07ab16bd8a5d29335f, user_id=05ef8ca1f3b24c1fa72de61b6466db57, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:11.471470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4a950-5255-4e06-b5c8-1199f928c359 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:11.604151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1252/2484] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:11 2022] PUT /identity/v3/projects/22308e7decc74c07ab16bd8a5d29335f/users/05ef8ca1f3b24c1fa72de61b6466db57/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:11.608431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61a0ce-6ec8-4ba8-880b-fcb657f3fb57 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:11.619485 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61a0ce-6ec8-4ba8-880b-fcb657f3fb57 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:11.698056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f90fd2-43e0-4a8b-a1ab-889cb2928bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:11.698977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f90fd2-43e0-4a8b-a1ab-889cb2928bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:11.699285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f90fd2-43e0-4a8b-a1ab-889cb2928bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:11.699650 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f90fd2-43e0-4a8b-a1ab-889cb2928bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:11.700224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f90fd2-43e0-4a8b-a1ab-889cb2928bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:11.701912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f90fd2-43e0-4a8b-a1ab-889cb2928bf6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:11.717410 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1233/2485] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:11.723356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a950-5255-4e06-b5c8-1199f928c359 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:11.738177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a950-5255-4e06-b5c8-1199f928c359 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:11.748697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e261d51-8912-4304-9a71-64c6855abadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:11.748697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e261d51-8912-4304-9a71-64c6855abadc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:11.748697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e261d51-8912-4304-9a71-64c6855abadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:11.748697 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e261d51-8912-4304-9a71-64c6855abadc admin admin] PATH_INFO: `/v3/projects/22308e7decc74c07ab16bd8a5d29335f/users/05ef8ca1f3b24c1fa72de61b6466db57/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:11.750729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e261d51-8912-4304-9a71-64c6855abadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=22308e7decc74c07ab16bd8a5d29335f, user_id=05ef8ca1f3b24c1fa72de61b6466db57, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:11.750729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e261d51-8912-4304-9a71-64c6855abadc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:11.771586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1253/2486] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:11 2022] PUT /identity/v3/projects/22308e7decc74c07ab16bd8a5d29335f/users/05ef8ca1f3b24c1fa72de61b6466db57/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:11.783204 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec975-bb1b-4e9d-8c30-c4cd06215df1 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:11.785012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec975-bb1b-4e9d-8c30-c4cd06215df1 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:11.785012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec975-bb1b-4e9d-8c30-c4cd06215df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:11.828166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-36aec975-bb1b-4e9d-8c30-c4cd06215df1 None None] MFA Rules not processed for user `05ef8ca1f3b24c1fa72de61b6466db57`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:11.834725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-36aec975-bb1b-4e9d-8c30-c4cd06215df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:11.917024 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1234/2487] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:11.930415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e261d51-8912-4304-9a71-64c6855abadc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:11.934199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6e261d51-8912-4304-9a71-64c6855abadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:12.008462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e261d51-8912-4304-9a71-64c6855abadc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:12.012511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e9ae9-ff10-4fbd-9dc9-b01f4d491347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:12.013211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e9ae9-ff10-4fbd-9dc9-b01f4d491347 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:12.013402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e9ae9-ff10-4fbd-9dc9-b01f4d491347 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:12.013684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e9ae9-ff10-4fbd-9dc9-b01f4d491347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:12.024049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e9ae9-ff10-4fbd-9dc9-b01f4d491347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:12.025730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e9ae9-ff10-4fbd-9dc9-b01f4d491347 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:12.042485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1254/2488] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:12.469242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc91dbc-dab7-4c37-9870-c4c0f58a8a6c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:12.469754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc91dbc-dab7-4c37-9870-c4c0f58a8a6c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:12.470182 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc91dbc-dab7-4c37-9870-c4c0f58a8a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:12.508566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bfc91dbc-dab7-4c37-9870-c4c0f58a8a6c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:12.509893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bfc91dbc-dab7-4c37-9870-c4c0f58a8a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:12.592540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:12.640941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1235/2489] 10.222.0.93 () {58 vars in 1016 bytes} [Wed Aug 24 03:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:12.667387 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e9ae9-ff10-4fbd-9dc9-b01f4d491347 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:12.670464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-432e9ae9-ff10-4fbd-9dc9-b01f4d491347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:12.712860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:12.860425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e9ae9-ff10-4fbd-9dc9-b01f4d491347 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:12.894595 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d4d5f-9b95-47d1-88c0-f6f161f47b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:12.897062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d4d5f-9b95-47d1-88c0-f6f161f47b5b service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:12.897509 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d4d5f-9b95-47d1-88c0-f6f161f47b5b service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:12.898312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d4d5f-9b95-47d1-88c0-f6f161f47b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:12.916405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d4d5f-9b95-47d1-88c0-f6f161f47b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:12.918760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d4d5f-9b95-47d1-88c0-f6f161f47b5b service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:12.933839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1255/2490] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:13.416738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc91dbc-dab7-4c37-9870-c4c0f58a8a6c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:13.428353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc91dbc-dab7-4c37-9870-c4c0f58a8a6c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:13.434460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:13.435348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:13.435872 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:13.436318 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] PATH_INFO: `/v3/users/74afc8b7e73441afa5972ddab17d43f2` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:13.438138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=74afc8b7e73441afa5972ddab17d43f2)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:13.440995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:13.490795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d4d5f-9b95-47d1-88c0-f6f161f47b5b service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:13.494519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fe6d4d5f-9b95-47d1-88c0-f6f161f47b5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:13.506463 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d4d5f-9b95-47d1-88c0-f6f161f47b5b service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:13.512311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cd40f-443e-407c-bebe-d030fb2b5c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:13.513202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd40f-443e-407c-bebe-d030fb2b5c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:13.513480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd40f-443e-407c-bebe-d030fb2b5c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:13.513823 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd40f-443e-407c-bebe-d030fb2b5c7d admin admin] PATH_INFO: `/v3/users/46fba300a0e942a0978221fe8f8b8bfc` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:13.515093 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cd40f-443e-407c-bebe-d030fb2b5c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46fba300a0e942a0978221fe8f8b8bfc)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:13.517074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cd40f-443e-407c-bebe-d030fb2b5c7d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:13.701709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74afc8b7e73441afa5972ddab17d43f2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:13.727395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a94cd40f-443e-407c-bebe-d030fb2b5c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46fba300a0e942a0978221fe8f8b8bfc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:13.728067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a94cd40f-443e-407c-bebe-d030fb2b5c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46fba300a0e942a0978221fe8f8b8bfc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:13.728788 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a94cd40f-443e-407c-bebe-d030fb2b5c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46fba300a0e942a0978221fe8f8b8bfc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:13.804663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74afc8b7e73441afa5972ddab17d43f2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:13.813784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74afc8b7e73441afa5972ddab17d43f2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:13.815240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74afc8b7e73441afa5972ddab17d43f2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:13.830526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74afc8b7e73441afa5972ddab17d43f2'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:13.841104 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1236/2491] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:13 2022] DELETE /identity/v3/users/74afc8b7e73441afa5972ddab17d43f2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:13.841104 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:13.844036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:13.862361 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a94cd40f-443e-407c-bebe-d030fb2b5c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46fba300a0e942a0978221fe8f8b8bfc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:13.881210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a94cd40f-443e-407c-bebe-d030fb2b5c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46fba300a0e942a0978221fe8f8b8bfc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:13.911102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1256/2492] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:13 2022] DELETE /identity/v3/users/46fba300a0e942a0978221fe8f8b8bfc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:13.912470 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d17e6e-a18a-44c3-b33a-061e2c7cdb9d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:13.912759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d17e6e-a18a-44c3-b33a-061e2c7cdb9d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:13.914237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d17e6e-a18a-44c3-b33a-061e2c7cdb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:13.932448 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f8d8a-4975-4a3e-aca3-53a443d09c8e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:13.936592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e2d17e6e-a18a-44c3-b33a-061e2c7cdb9d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:13.937879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e2d17e6e-a18a-44c3-b33a-061e2c7cdb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:14.006712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1257/2493] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:14.014565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcace7-176a-4557-be0e-3eb0e3c90476 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:14.015244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:14.015473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcace7-176a-4557-be0e-3eb0e3c90476 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:14.015473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcace7-176a-4557-be0e-3eb0e3c90476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:14.021786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04b925-59a8-44fa-b6ed-bd07484f4686 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:14.022643 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04b925-59a8-44fa-b6ed-bd07484f4686 service placement] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:14.023206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04b925-59a8-44fa-b6ed-bd07484f4686 service placement] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:14.023714 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04b925-59a8-44fa-b6ed-bd07484f4686 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:14.025736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ce04b925-59a8-44fa-b6ed-bd07484f4686 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:14.038986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04b925-59a8-44fa-b6ed-bd07484f4686 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:14.043318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-79dcace7-176a-4557-be0e-3eb0e3c90476 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:14.043318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79dcace7-176a-4557-be0e-3eb0e3c90476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:14.043598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04b925-59a8-44fa-b6ed-bd07484f4686 service placement] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:14.051194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1258/2494] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:14.051194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcace7-176a-4557-be0e-3eb0e3c90476 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:14.052491 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-79dcace7-176a-4557-be0e-3eb0e3c90476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:14.052638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1237/2495] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:14.060990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:14.062700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04b925-59a8-44fa-b6ed-bd07484f4686 service placement] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:14.064452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ce04b925-59a8-44fa-b6ed-bd07484f4686 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:14.137376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcace7-176a-4557-be0e-3eb0e3c90476 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:14.142769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6b3b-a856-477b-b990-fbe7c7d08d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:14.143453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6b3b-a856-477b-b990-fbe7c7d08d3e service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:14.143739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6b3b-a856-477b-b990-fbe7c7d08d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:14.144160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6b3b-a856-477b-b990-fbe7c7d08d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:14.160219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04b925-59a8-44fa-b6ed-bd07484f4686 service placement] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:14.161637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6b3b-a856-477b-b990-fbe7c7d08d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:14.164668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6b3b-a856-477b-b990-fbe7c7d08d3e service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:14.164906 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010abdcd-dd1d-427c-a75e-c629d892edb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:14.165530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010abdcd-dd1d-427c-a75e-c629d892edb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:14.165813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010abdcd-dd1d-427c-a75e-c629d892edb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:14.166090 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010abdcd-dd1d-427c-a75e-c629d892edb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:14.178677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010abdcd-dd1d-427c-a75e-c629d892edb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:14.180189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010abdcd-dd1d-427c-a75e-c629d892edb9 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:14.181469 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1259/2496] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:14.192422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1238/2497] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:14.797328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6b3b-a856-477b-b990-fbe7c7d08d3e service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:14.799063 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fb0b6b3b-a856-477b-b990-fbe7c7d08d3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:14.800682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010abdcd-dd1d-427c-a75e-c629d892edb9 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:14.803484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-010abdcd-dd1d-427c-a75e-c629d892edb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:14.816169 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6b3b-a856-477b-b990-fbe7c7d08d3e service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:14.820067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010abdcd-dd1d-427c-a75e-c629d892edb9 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:14.830959 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:14.833366 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:14.833366 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:14.833794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] PATH_INFO: `/v3/projects/a7656cdb1b03423a8388cb52c82052c7` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:14.834807 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:14.835478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:14.857689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:14.858629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7656cdb1b03423a8388cb52c82052c7)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:14.858905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] PATH_INFO: `/v3/projects/c4bf7860b5034559b1cbb99bf9e363b8` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:14.860577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bf7860b5034559b1cbb99bf9e363b8)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:14.860733 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:14.869799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:15.070719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bf7860b5034559b1cbb99bf9e363b8', 'request_id': 'req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.073037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7656cdb1b03423a8388cb52c82052c7', 'request_id': 'req-bfb14bac-6802-49ae-b1a0-0cd5666b9561'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.086468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bf7860b5034559b1cbb99bf9e363b8', 'request_id': 'req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.161957 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7656cdb1b03423a8388cb52c82052c7', 'request_id': 'req-bfb14bac-6802-49ae-b1a0-0cd5666b9561'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.168734 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7656cdb1b03423a8388cb52c82052c7', 'request_id': 'req-bfb14bac-6802-49ae-b1a0-0cd5666b9561'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.182061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] The token cache is being invalidate because project a7656cdb1b03423a8388cb52c82052c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:15.182359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.183074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bfb14bac-6802-49ae-b1a0-0cd5666b9561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.185177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1260/2498] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:14 2022] DELETE /identity/v3/projects/a7656cdb1b03423a8388cb52c82052c7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:15.189872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59fcb-248d-4a01-bbc7-7017cb665c9c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:15.190334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59fcb-248d-4a01-bbc7-7017cb665c9c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:15.190480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc59fcb-248d-4a01-bbc7-7017cb665c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:15.212322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6fc59fcb-248d-4a01-bbc7-7017cb665c9c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:15.213513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6fc59fcb-248d-4a01-bbc7-7017cb665c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:15.282452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1261/2499] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:15.290183 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8f6c7-e57a-47bf-a7fc-90058e7185ad None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:15.290498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8f6c7-e57a-47bf-a7fc-90058e7185ad None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:15.290748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8f6c7-e57a-47bf-a7fc-90058e7185ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:15.305398 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bf7860b5034559b1cbb99bf9e363b8', 'request_id': 'req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.317237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-ddd8f6c7-e57a-47bf-a7fc-90058e7185ad None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:15.318899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-ddd8f6c7-e57a-47bf-a7fc-90058e7185ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:15.331002 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] The token cache is being invalidate because project c4bf7860b5034559b1cbb99bf9e363b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:15.331643 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.332624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.333759 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1262/2500] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:15.334695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8f6c7-e57a-47bf-a7fc-90058e7185ad None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:15.335478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1239/2501] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:14 2022] DELETE /identity/v3/projects/c4bf7860b5034559b1cbb99bf9e363b8 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:15.345218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8f6c7-e57a-47bf-a7fc-90058e7185ad None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:15.349117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:15.350473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd3c2d-76d1-4a89-a41d-020ffc35b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:15.351431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd3c2d-76d1-4a89-a41d-020ffc35b2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:15.351720 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd3c2d-76d1-4a89-a41d-020ffc35b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:15.352001 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd3c2d-76d1-4a89-a41d-020ffc35b2d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:15.352464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:15.354359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd3c2d-76d1-4a89-a41d-020ffc35b2d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:15.354696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd3c2d-76d1-4a89-a41d-020ffc35b2d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:15.357127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd3c2d-76d1-4a89-a41d-020ffc35b2d3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:15.368480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fabd59-f7a9-4312-a6d1-8e5e9ca9bbc0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:15.374712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:15.375665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:15.381069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:15.381069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] PATH_INFO: `/v3/users/05ef8ca1f3b24c1fa72de61b6466db57` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:15.381069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ef8ca1f3b24c1fa72de61b6466db57)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:15.381069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:15.381460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1263/2502] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:55:15.389550 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd3c2d-76d1-4a89-a41d-020ffc35b2d3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:15.394529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0ecd3c2d-76d1-4a89-a41d-020ffc35b2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:15.412737 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd3c2d-76d1-4a89-a41d-020ffc35b2d3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:15.417479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4da95d-eb7b-4e87-9f45-c35c7b20d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:15.418659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4da95d-eb7b-4e87-9f45-c35c7b20d736 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:15.418932 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4da95d-eb7b-4e87-9f45-c35c7b20d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:15.419230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4da95d-eb7b-4e87-9f45-c35c7b20d736 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:15.419860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4da95d-eb7b-4e87-9f45-c35c7b20d736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:15.421894 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4da95d-eb7b-4e87-9f45-c35c7b20d736 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:15.429785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:15.584465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1264/2503] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:15 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:15.588842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4da95d-eb7b-4e87-9f45-c35c7b20d736 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:15.643566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ef8ca1f3b24c1fa72de61b6466db57'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.710906 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4da95d-eb7b-4e87-9f45-c35c7b20d736 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:15.717544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc2c21-1ec9-4d37-81f7-83b584153f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:15.718464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc2c21-1ec9-4d37-81f7-83b584153f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:15.718740 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc2c21-1ec9-4d37-81f7-83b584153f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:15.719027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc2c21-1ec9-4d37-81f7-83b584153f9f admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:15.719705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc2c21-1ec9-4d37-81f7-83b584153f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:15.721726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc2c21-1ec9-4d37-81f7-83b584153f9f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:15.744193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ef8ca1f3b24c1fa72de61b6466db57'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.759264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ef8ca1f3b24c1fa72de61b6466db57'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.760206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ef8ca1f3b24c1fa72de61b6466db57'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.768579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:15.775810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ef8ca1f3b24c1fa72de61b6466db57'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:15.788539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1240/2504] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:15 2022] DELETE /identity/v3/users/05ef8ca1f3b24c1fa72de61b6466db57 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:15.853844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1265/2505] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:15 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:15.858201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:15.859703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:15.949127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bfe79-1d2a-4073-a0eb-47bec9a22186 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:15.954311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c112c7-04ff-410f-af10-e59bef580554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:15.955234 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c112c7-04ff-410f-af10-e59bef580554 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:15.955547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c112c7-04ff-410f-af10-e59bef580554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:15.955794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c112c7-04ff-410f-af10-e59bef580554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:15.956463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c112c7-04ff-410f-af10-e59bef580554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:15.958113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c112c7-04ff-410f-af10-e59bef580554 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:15.970546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1241/2506] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:15.994768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc2c21-1ec9-4d37-81f7-83b584153f9f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:15.994768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc2c21-1ec9-4d37-81f7-83b584153f9f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:15.996726 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcefd6a-0edd-43a4-8ae1-46f8f4c5f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:15.997695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcefd6a-0edd-43a4-8ae1-46f8f4c5f97c admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:15.998096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcefd6a-0edd-43a4-8ae1-46f8f4c5f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:15.998471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcefd6a-0edd-43a4-8ae1-46f8f4c5f97c admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:15.999281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcefd6a-0edd-43a4-8ae1-46f8f4c5f97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:16.001460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcefd6a-0edd-43a4-8ae1-46f8f4c5f97c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:16.017074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1266/2507] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:16.021257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c112c7-04ff-410f-af10-e59bef580554 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:16.034567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c112c7-04ff-410f-af10-e59bef580554 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:16.040579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95607aaa-17ba-4087-83db-d4e2fba89a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:16.041341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95607aaa-17ba-4087-83db-d4e2fba89a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:16.041727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95607aaa-17ba-4087-83db-d4e2fba89a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:16.042357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95607aaa-17ba-4087-83db-d4e2fba89a66 admin admin] PATH_INFO: `/v3/projects/b76c099d966e4421ae576bf01e1dcb75/users/104847bca2e5456c84a631f22823c8a9/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:16.070059 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95607aaa-17ba-4087-83db-d4e2fba89a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76c099d966e4421ae576bf01e1dcb75, user_id=104847bca2e5456c84a631f22823c8a9, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:16.073837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95607aaa-17ba-4087-83db-d4e2fba89a66 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:16.246816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1242/2508] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:16 2022] PUT /identity/v3/projects/b76c099d966e4421ae576bf01e1dcb75/users/104847bca2e5456c84a631f22823c8a9/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:16.256955 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4bb9f-c054-4057-bdd9-52db3cdab6b5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:16.257515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4bb9f-c054-4057-bdd9-52db3cdab6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:16.257613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4bb9f-c054-4057-bdd9-52db3cdab6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:16.291395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9cb4bb9f-c054-4057-bdd9-52db3cdab6b5 None None] MFA Rules not processed for user `104847bca2e5456c84a631f22823c8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:16.292603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9cb4bb9f-c054-4057-bdd9-52db3cdab6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:16.366727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1267/2509] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:16.396309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95607aaa-17ba-4087-83db-d4e2fba89a66 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:16.398039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-95607aaa-17ba-4087-83db-d4e2fba89a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:16.462123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95607aaa-17ba-4087-83db-d4e2fba89a66 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:16.467395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b3038-4a5d-4dd7-a3cf-a1df2d036d90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:16.468108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b3038-4a5d-4dd7-a3cf-a1df2d036d90 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:16.468470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b3038-4a5d-4dd7-a3cf-a1df2d036d90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:16.468812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b3038-4a5d-4dd7-a3cf-a1df2d036d90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:16.478853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b3038-4a5d-4dd7-a3cf-a1df2d036d90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:16.480958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b3038-4a5d-4dd7-a3cf-a1df2d036d90 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:16.490759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1243/2510] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:16.742453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4bb9f-c054-4057-bdd9-52db3cdab6b5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:16.743972 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9cb4bb9f-c054-4057-bdd9-52db3cdab6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:16.824010 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4bb9f-c054-4057-bdd9-52db3cdab6b5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:16.829205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:16.830378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:16.830378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:16.830613 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] PATH_INFO: `/v3/projects/22308e7decc74c07ab16bd8a5d29335f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:16.831605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22308e7decc74c07ab16bd8a5d29335f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:16.833598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:17.031191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22308e7decc74c07ab16bd8a5d29335f', 'request_id': 'req-6ed93aed-d03e-43c6-a621-61bece44ef15'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:17.117109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22308e7decc74c07ab16bd8a5d29335f', 'request_id': 'req-6ed93aed-d03e-43c6-a621-61bece44ef15'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:17.130181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22308e7decc74c07ab16bd8a5d29335f', 'request_id': 'req-6ed93aed-d03e-43c6-a621-61bece44ef15'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:17.156063 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] The token cache is being invalidate because project 22308e7decc74c07ab16bd8a5d29335f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:17.156375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:17.159476 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6ed93aed-d03e-43c6-a621-61bece44ef15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:17.164081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1268/2511] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:16 2022] DELETE /identity/v3/projects/22308e7decc74c07ab16bd8a5d29335f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:17.168940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350953-fe96-4b6b-8f09-b216d1b303ef None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:17.177270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350953-fe96-4b6b-8f09-b216d1b303ef None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:17.177270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350953-fe96-4b6b-8f09-b216d1b303ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:17.208184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b0350953-fe96-4b6b-8f09-b216d1b303ef None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:17.209558 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b0350953-fe96-4b6b-8f09-b216d1b303ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:17.329470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1244/2512] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:17.337728 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921690c-e46f-47de-83a2-5b63dc322774 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:17.338667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921690c-e46f-47de-83a2-5b63dc322774 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:17.339208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921690c-e46f-47de-83a2-5b63dc322774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:17.400899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f921690c-e46f-47de-83a2-5b63dc322774 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:17.402671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f921690c-e46f-47de-83a2-5b63dc322774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:17.429135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1269/2513] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:17.437538 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350953-fe96-4b6b-8f09-b216d1b303ef None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:17.451774 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350953-fe96-4b6b-8f09-b216d1b303ef None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:17.464402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:17.469108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcb6d7-48b3-4a0a-baab-992a70fea04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:17.473738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcb6d7-48b3-4a0a-baab-992a70fea04f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:17.473738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcb6d7-48b3-4a0a-baab-992a70fea04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:17.473738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcb6d7-48b3-4a0a-baab-992a70fea04f admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:17.473738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcb6d7-48b3-4a0a-baab-992a70fea04f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:17.473738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcb6d7-48b3-4a0a-baab-992a70fea04f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:17.473738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcb6d7-48b3-4a0a-baab-992a70fea04f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:17.518125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921690c-e46f-47de-83a2-5b63dc322774 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:17.522619 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1245/2514] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:55:17.532780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921690c-e46f-47de-83a2-5b63dc322774 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:17.540455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493cd20-473e-4954-8ec8-f6d454d62bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:17.541641 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493cd20-473e-4954-8ec8-f6d454d62bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:17.542451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493cd20-473e-4954-8ec8-f6d454d62bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:17.543798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493cd20-473e-4954-8ec8-f6d454d62bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:17.545374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493cd20-473e-4954-8ec8-f6d454d62bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:17.548378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493cd20-473e-4954-8ec8-f6d454d62bc8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:17.697155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcb6d7-48b3-4a0a-baab-992a70fea04f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:17.704836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d5fcb6d7-48b3-4a0a-baab-992a70fea04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:17.710927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1270/2515] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:17 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:17.711961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493cd20-473e-4954-8ec8-f6d454d62bc8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:17.805966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493cd20-473e-4954-8ec8-f6d454d62bc8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:17.811854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb467-aa2f-48bd-8afb-7af4a24ee97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:17.812814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb467-aa2f-48bd-8afb-7af4a24ee97a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:17.813199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb467-aa2f-48bd-8afb-7af4a24ee97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:17.813619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb467-aa2f-48bd-8afb-7af4a24ee97a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:17.814360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb467-aa2f-48bd-8afb-7af4a24ee97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:17.817163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb467-aa2f-48bd-8afb-7af4a24ee97a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:17.819158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcb6d7-48b3-4a0a-baab-992a70fea04f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:17.896418 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcbd47-7274-4028-b1f6-0b5e55cee34a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:17.901164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcbd47-7274-4028-b1f6-0b5e55cee34a service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:17.901164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcbd47-7274-4028-b1f6-0b5e55cee34a service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:17.901164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcbd47-7274-4028-b1f6-0b5e55cee34a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:17.901164 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c7dcbd47-7274-4028-b1f6-0b5e55cee34a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:17.919186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcbd47-7274-4028-b1f6-0b5e55cee34a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:17.920750 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcbd47-7274-4028-b1f6-0b5e55cee34a service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:17.932620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1271/2516] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:17 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:17.933657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb467-aa2f-48bd-8afb-7af4a24ee97a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:17.934214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1246/2517] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:17.952989 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb467-aa2f-48bd-8afb-7af4a24ee97a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:17.960331 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421839-36da-4884-b9cd-31cf85f55428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:17.960970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421839-36da-4884-b9cd-31cf85f55428 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:17.961392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421839-36da-4884-b9cd-31cf85f55428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:17.961520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421839-36da-4884-b9cd-31cf85f55428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:17.962725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09421839-36da-4884-b9cd-31cf85f55428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:17.964021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09421839-36da-4884-b9cd-31cf85f55428 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:17.976987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1272/2518] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:17.981829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcbd47-7274-4028-b1f6-0b5e55cee34a service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:17.993288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcbd47-7274-4028-b1f6-0b5e55cee34a service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:18.004911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:18.009078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077197e-2fa6-4a82-a617-9a66fec6db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:18.009709 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077197e-2fa6-4a82-a617-9a66fec6db72 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:18.015249 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077197e-2fa6-4a82-a617-9a66fec6db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:18.015635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077197e-2fa6-4a82-a617-9a66fec6db72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:18.016340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077197e-2fa6-4a82-a617-9a66fec6db72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:18.018000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077197e-2fa6-4a82-a617-9a66fec6db72 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:18.042436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1247/2519] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:18.044262 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421839-36da-4884-b9cd-31cf85f55428 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:18.056687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421839-36da-4884-b9cd-31cf85f55428 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:18.068939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb3688-b906-450b-bc08-5938383cfdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:18.068939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb3688-b906-450b-bc08-5938383cfdc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:18.068939 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb3688-b906-450b-bc08-5938383cfdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:18.070996 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb3688-b906-450b-bc08-5938383cfdc2 admin admin] PATH_INFO: `/v3/projects/2e9af643bb404cc0ad865db36398ed8b/users/281f85200da644e8bd9ca6bb3b6a6b6c/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:18.091760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb3688-b906-450b-bc08-5938383cfdc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9af643bb404cc0ad865db36398ed8b, user_id=281f85200da644e8bd9ca6bb3b6a6b6c, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:18.094497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb3688-b906-450b-bc08-5938383cfdc2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:18.220320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1273/2520] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:18 2022] PUT /identity/v3/projects/2e9af643bb404cc0ad865db36398ed8b/users/281f85200da644e8bd9ca6bb3b6a6b6c/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:18.231818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fab0a0-f66d-4b64-9761-41efa85aeb8b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:18.232332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fab0a0-f66d-4b64-9761-41efa85aeb8b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:18.232428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fab0a0-f66d-4b64-9761-41efa85aeb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:18.261942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-29fab0a0-f66d-4b64-9761-41efa85aeb8b None None] MFA Rules not processed for user `281f85200da644e8bd9ca6bb3b6a6b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:18.263535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-29fab0a0-f66d-4b64-9761-41efa85aeb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:18.331668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1248/2521] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:18.336468 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb3688-b906-450b-bc08-5938383cfdc2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:18.384328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fab0a0-f66d-4b64-9761-41efa85aeb8b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:18.385958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-29fab0a0-f66d-4b64-9761-41efa85aeb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:18.415179 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb3688-b906-450b-bc08-5938383cfdc2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:18.422229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e8464-5d32-48d9-8967-8c6fecf3e84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:18.423147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e8464-5d32-48d9-8967-8c6fecf3e84d admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:18.423507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e8464-5d32-48d9-8967-8c6fecf3e84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:18.423859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e8464-5d32-48d9-8967-8c6fecf3e84d admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:18.424570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e8464-5d32-48d9-8967-8c6fecf3e84d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:18.426608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e8464-5d32-48d9-8967-8c6fecf3e84d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:18.461725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fab0a0-f66d-4b64-9761-41efa85aeb8b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:18.466819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:18.467479 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:18.468337 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:18.468616 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] PATH_INFO: `/v3/users/9a860afe6fe84559bf32f76567807889` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:18.470019 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a860afe6fe84559bf32f76567807889)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:18.472155 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:18.546612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1274/2522] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:18 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:18.550706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e8464-5d32-48d9-8967-8c6fecf3e84d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:18.627075 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e8464-5d32-48d9-8967-8c6fecf3e84d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:18.631965 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ec48e-4221-4dd9-aa01-41c49059689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:18.632837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ec48e-4221-4dd9-aa01-41c49059689a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:18.633181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ec48e-4221-4dd9-aa01-41c49059689a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:18.633384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ec48e-4221-4dd9-aa01-41c49059689a admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:18.634029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ec48e-4221-4dd9-aa01-41c49059689a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:18.636026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ec48e-4221-4dd9-aa01-41c49059689a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:18.675463 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a860afe6fe84559bf32f76567807889'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:18.778848 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1275/2523] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:18 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:18.782906 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ec48e-4221-4dd9-aa01-41c49059689a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:18.794388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ec48e-4221-4dd9-aa01-41c49059689a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:18.799608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242338a-472a-4c14-9cf8-1743e5b9a4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:18.800233 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242338a-472a-4c14-9cf8-1743e5b9a4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:18.800654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242338a-472a-4c14-9cf8-1743e5b9a4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:18.800941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242338a-472a-4c14-9cf8-1743e5b9a4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:18.801607 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242338a-472a-4c14-9cf8-1743e5b9a4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:18.803285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242338a-472a-4c14-9cf8-1743e5b9a4d2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:18.813589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a860afe6fe84559bf32f76567807889'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:18.817476 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1276/2524] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:18.821420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242338a-472a-4c14-9cf8-1743e5b9a4d2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:18.825695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a860afe6fe84559bf32f76567807889'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:18.826049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a860afe6fe84559bf32f76567807889'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:18.832297 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242338a-472a-4c14-9cf8-1743e5b9a4d2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:18.837815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc970533-9f33-413a-8303-913153bd31eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:18.838491 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc970533-9f33-413a-8303-913153bd31eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:18.838776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc970533-9f33-413a-8303-913153bd31eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:18.839074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc970533-9f33-413a-8303-913153bd31eb admin admin] PATH_INFO: `/v3/projects/f7871bbea2c94f19814028196e8ebf90/users/929df4f969f24b42bdba7d89068b377f/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:18.847468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a860afe6fe84559bf32f76567807889'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:18.853948 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1249/2525] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:18 2022] DELETE /identity/v3/users/9a860afe6fe84559bf32f76567807889 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:18.858886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc970533-9f33-413a-8303-913153bd31eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7871bbea2c94f19814028196e8ebf90, user_id=929df4f969f24b42bdba7d89068b377f, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:18.861623 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc970533-9f33-413a-8303-913153bd31eb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:18.987345 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1277/2526] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:18 2022] PUT /identity/v3/projects/f7871bbea2c94f19814028196e8ebf90/users/929df4f969f24b42bdba7d89068b377f/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:18.988615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:18.990406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:19.078673 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260e684-c29b-4d93-b4a1-b0c598ceacc9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:19.156221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc970533-9f33-413a-8303-913153bd31eb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:19.160191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cc970533-9f33-413a-8303-913153bd31eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:19.168575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d6a35-dabc-4b49-834c-a12330ce0857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:19.169212 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d6a35-dabc-4b49-834c-a12330ce0857 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:19.169497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d6a35-dabc-4b49-834c-a12330ce0857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:19.169838 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d6a35-dabc-4b49-834c-a12330ce0857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:19.170425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d6a35-dabc-4b49-834c-a12330ce0857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:19.174370 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d6a35-dabc-4b49-834c-a12330ce0857 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:19.201402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc970533-9f33-413a-8303-913153bd31eb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:19.218739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1250/2527] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:19.222462 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d6a35-dabc-4b49-834c-a12330ce0857 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:19.226798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:19.227683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:19.228181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:19.228666 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] PATH_INFO: `/v3/projects/89ad6fb4e09240e288e9ae96b9f6b443` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:19.229853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ad6fb4e09240e288e9ae96b9f6b443)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:19.233369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:19.237800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d6a35-dabc-4b49-834c-a12330ce0857 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:19.244536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdaf6c-68ce-4ecc-8ceb-b463d89fe5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:19.246286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdaf6c-68ce-4ecc-8ceb-b463d89fe5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:19.246730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdaf6c-68ce-4ecc-8ceb-b463d89fe5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:19.247225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdaf6c-68ce-4ecc-8ceb-b463d89fe5a2 admin admin] PATH_INFO: `/v3/projects/f7871bbea2c94f19814028196e8ebf90/users/929df4f969f24b42bdba7d89068b377f/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:19.251483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdaf6c-68ce-4ecc-8ceb-b463d89fe5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7871bbea2c94f19814028196e8ebf90, user_id=929df4f969f24b42bdba7d89068b377f, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:19.255445 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdaf6c-68ce-4ecc-8ceb-b463d89fe5a2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:19.270612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1251/2528] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:19 2022] PUT /identity/v3/projects/f7871bbea2c94f19814028196e8ebf90/users/929df4f969f24b42bdba7d89068b377f/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:19.281575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc720a-2da9-4509-9d3d-ea10d4bcb319 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:19.281966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc720a-2da9-4509-9d3d-ea10d4bcb319 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:19.282280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc720a-2da9-4509-9d3d-ea10d4bcb319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:19.346841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-60fc720a-2da9-4509-9d3d-ea10d4bcb319 None None] MFA Rules not processed for user `929df4f969f24b42bdba7d89068b377f`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:19.346841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-60fc720a-2da9-4509-9d3d-ea10d4bcb319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:19.446877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1252/2529] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:19.459611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc720a-2da9-4509-9d3d-ea10d4bcb319 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:19.461098 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-60fc720a-2da9-4509-9d3d-ea10d4bcb319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:19.480897 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ad6fb4e09240e288e9ae96b9f6b443', 'request_id': 'req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:19.526024 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc720a-2da9-4509-9d3d-ea10d4bcb319 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:19.577745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1eb2c-7e41-4b2c-950f-b681a2781936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:19.578371 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1eb2c-7e41-4b2c-950f-b681a2781936 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:19.578651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1eb2c-7e41-4b2c-950f-b681a2781936 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:19.578930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1eb2c-7e41-4b2c-950f-b681a2781936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:19.580764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7ba1eb2c-7e41-4b2c-950f-b681a2781936 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:19.612545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ad6fb4e09240e288e9ae96b9f6b443', 'request_id': 'req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:19.622779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ad6fb4e09240e288e9ae96b9f6b443', 'request_id': 'req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:19.641064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] The token cache is being invalidate because project 89ad6fb4e09240e288e9ae96b9f6b443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:19.641594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:19.642586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:19.645150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1278/2530] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:19 2022] DELETE /identity/v3/projects/89ad6fb4e09240e288e9ae96b9f6b443 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:19.650543 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:19.652994 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:19.654588 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:19.659197 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1eb2c-7e41-4b2c-950f-b681a2781936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:19.660886 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1eb2c-7e41-4b2c-950f-b681a2781936 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:19.672481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1253/2531] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:19.744715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbac56-7ad7-4c4e-8bcf-cf29939fd917 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:19.750879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:19.751664 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:19.752065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:19.752435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] PATH_INFO: `/v3/users/4f3bdb82261a4f3599fe5afb9665edda` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:19.754920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3bdb82261a4f3599fe5afb9665edda)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:19.758831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:20.059396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3bdb82261a4f3599fe5afb9665edda'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:20.060122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3bdb82261a4f3599fe5afb9665edda'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:20.060756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3bdb82261a4f3599fe5afb9665edda'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:20.240946 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3bdb82261a4f3599fe5afb9665edda'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:20.270123 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3bdb82261a4f3599fe5afb9665edda'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:20.293287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1279/2532] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:19 2022] DELETE /identity/v3/users/4f3bdb82261a4f3599fe5afb9665edda => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:20.667091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1eb2c-7e41-4b2c-950f-b681a2781936 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:20.684121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1eb2c-7e41-4b2c-950f-b681a2781936 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:20.757149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:20.757797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:20.758072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:20.758345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] PATH_INFO: `/v3/projects/580b3fa971e34afa8035f1f700ac7a89` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:20.759746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=580b3fa971e34afa8035f1f700ac7a89)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:20.762595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:20.912596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580b3fa971e34afa8035f1f700ac7a89', 'request_id': 'req-dd37a2f0-2994-4062-a23a-9269abce1e19'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:20.921354 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580b3fa971e34afa8035f1f700ac7a89', 'request_id': 'req-dd37a2f0-2994-4062-a23a-9269abce1e19'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:21.039219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580b3fa971e34afa8035f1f700ac7a89', 'request_id': 'req-dd37a2f0-2994-4062-a23a-9269abce1e19'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:21.054766 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] The token cache is being invalidate because project 580b3fa971e34afa8035f1f700ac7a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:21.054766 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:21.055615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:21.057697 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1254/2533] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:20 2022] DELETE /identity/v3/projects/580b3fa971e34afa8035f1f700ac7a89 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:21.869939 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:22.249268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:22.250918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:22.265600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88712f-f3e2-41dc-9ed9-2f307385d2e1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:22.321521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967fde8-8d22-4d0e-a87b-c5f3f18cfd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:22.322130 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967fde8-8d22-4d0e-a87b-c5f3f18cfd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:22.322416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967fde8-8d22-4d0e-a87b-c5f3f18cfd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:22.322699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967fde8-8d22-4d0e-a87b-c5f3f18cfd15 admin admin] PATH_INFO: `/v3/users/f844fed122764361a93664842d60070e` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:22.324209 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967fde8-8d22-4d0e-a87b-c5f3f18cfd15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f844fed122764361a93664842d60070e)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:22.326192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967fde8-8d22-4d0e-a87b-c5f3f18cfd15 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:22.568747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d967fde8-8d22-4d0e-a87b-c5f3f18cfd15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f844fed122764361a93664842d60070e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:22.569402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d967fde8-8d22-4d0e-a87b-c5f3f18cfd15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f844fed122764361a93664842d60070e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:22.570013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d967fde8-8d22-4d0e-a87b-c5f3f18cfd15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f844fed122764361a93664842d60070e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:22.638764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d967fde8-8d22-4d0e-a87b-c5f3f18cfd15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f844fed122764361a93664842d60070e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:22.651467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d967fde8-8d22-4d0e-a87b-c5f3f18cfd15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f844fed122764361a93664842d60070e'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:22.664140 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1280/2534] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:22 2022] DELETE /identity/v3/users/f844fed122764361a93664842d60070e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:22.990724 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:22.992306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:23.006011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37a2f0-2994-4062-a23a-9269abce1e19 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:23.024875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:23.071347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:23.071986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:23.072269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:23.072545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] PATH_INFO: `/v3/projects/975ff359ca3f458c9008b497b474c93d` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:23.074557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=975ff359ca3f458c9008b497b474c93d)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:23.076565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:23.229245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975ff359ca3f458c9008b497b474c93d', 'request_id': 'req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:23.235108 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975ff359ca3f458c9008b497b474c93d', 'request_id': 'req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:23.241323 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:23.310594 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975ff359ca3f458c9008b497b474c93d', 'request_id': 'req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:23.324456 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] The token cache is being invalidate because project 975ff359ca3f458c9008b497b474c93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:23.324795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:23.325426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e5291f0f-a086-4f4b-91ed-c0cf59319aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:23.328324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1255/2535] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:22 2022] DELETE /identity/v3/projects/975ff359ca3f458c9008b497b474c93d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:23.333524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e25ef-febe-4dfc-94d9-cf7c2b3cf5e8 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:23.334049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e25ef-febe-4dfc-94d9-cf7c2b3cf5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:23.334174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e25ef-febe-4dfc-94d9-cf7c2b3cf5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:23.357951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-e98e25ef-febe-4dfc-94d9-cf7c2b3cf5e8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:23.359234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-e98e25ef-febe-4dfc-94d9-cf7c2b3cf5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:23.425574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1281/2536] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:23.434630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad7c4b-1885-48d8-b9d9-f67793ed5137 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:23.434915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad7c4b-1885-48d8-b9d9-f67793ed5137 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:23.435230 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad7c4b-1885-48d8-b9d9-f67793ed5137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:23.455432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-10ad7c4b-1885-48d8-b9d9-f67793ed5137 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:23.456566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-10ad7c4b-1885-48d8-b9d9-f67793ed5137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:23.465199 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1256/2537] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:23.470393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e25ef-febe-4dfc-94d9-cf7c2b3cf5e8 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:23.481091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e25ef-febe-4dfc-94d9-cf7c2b3cf5e8 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:23.485885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41a3b-ccbd-4274-90a3-7e3faf3eb015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:23.486508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41a3b-ccbd-4274-90a3-7e3faf3eb015 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:23.487181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41a3b-ccbd-4274-90a3-7e3faf3eb015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:23.487181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41a3b-ccbd-4274-90a3-7e3faf3eb015 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:23.487738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe41a3b-ccbd-4274-90a3-7e3faf3eb015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:23.488047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe41a3b-ccbd-4274-90a3-7e3faf3eb015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:23.489682 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe41a3b-ccbd-4274-90a3-7e3faf3eb015 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:23.502810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1282/2538] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:55:23.507288 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad7c4b-1885-48d8-b9d9-f67793ed5137 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:23.517099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad7c4b-1885-48d8-b9d9-f67793ed5137 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:23.522543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42a934-5581-4ff8-8170-3bc7f4a15fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:23.523274 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42a934-5581-4ff8-8170-3bc7f4a15fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:23.528078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42a934-5581-4ff8-8170-3bc7f4a15fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:23.528078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42a934-5581-4ff8-8170-3bc7f4a15fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:23.528078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42a934-5581-4ff8-8170-3bc7f4a15fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:23.528078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42a934-5581-4ff8-8170-3bc7f4a15fe5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:23.575076 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41a3b-ccbd-4274-90a3-7e3faf3eb015 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:23.576822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3fe41a3b-ccbd-4274-90a3-7e3faf3eb015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:23.637850 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41a3b-ccbd-4274-90a3-7e3faf3eb015 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:23.641760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff912c6-d5c3-480c-a76c-e59c462d3f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:23.642371 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff912c6-d5c3-480c-a76c-e59c462d3f2c service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:23.642648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff912c6-d5c3-480c-a76c-e59c462d3f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:23.642918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff912c6-d5c3-480c-a76c-e59c462d3f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:23.644723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-aff912c6-d5c3-480c-a76c-e59c462d3f2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:23.651167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1257/2539] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:23 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:23.653025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42a934-5581-4ff8-8170-3bc7f4a15fe5 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:23.711320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff912c6-d5c3-480c-a76c-e59c462d3f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:23.712841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff912c6-d5c3-480c-a76c-e59c462d3f2c service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:23.716566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42a934-5581-4ff8-8170-3bc7f4a15fe5 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:23.722862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cca08-c252-42ce-b179-cb92397d597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:23.722862 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cca08-c252-42ce-b179-cb92397d597a admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:23.723250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cca08-c252-42ce-b179-cb92397d597a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:23.723250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cca08-c252-42ce-b179-cb92397d597a admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:23.724039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1283/2540] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:23.725914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cca08-c252-42ce-b179-cb92397d597a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:23.727950 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cca08-c252-42ce-b179-cb92397d597a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:23.910657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1258/2541] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:23 2022] POST /identity/v3/users => generated 290 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:23.914872 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff912c6-d5c3-480c-a76c-e59c462d3f2c service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:23.929473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff912c6-d5c3-480c-a76c-e59c462d3f2c service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:23.934469 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e756c-4dbc-48dc-bf0f-1f08566e17ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:23.935375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e756c-4dbc-48dc-bf0f-1f08566e17ff admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:23.935660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e756c-4dbc-48dc-bf0f-1f08566e17ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:23.935954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e756c-4dbc-48dc-bf0f-1f08566e17ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:23.937283 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e756c-4dbc-48dc-bf0f-1f08566e17ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:23.939029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e756c-4dbc-48dc-bf0f-1f08566e17ff admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:23.951206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1284/2542] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:23.956715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cca08-c252-42ce-b179-cb92397d597a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:23.970381 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cca08-c252-42ce-b179-cb92397d597a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:23.976149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c476ec-6bd8-4570-ada7-034d3fc858eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:23.976453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c476ec-6bd8-4570-ada7-034d3fc858eb admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:23.976806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c476ec-6bd8-4570-ada7-034d3fc858eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:23.977150 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c476ec-6bd8-4570-ada7-034d3fc858eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:23.977937 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c476ec-6bd8-4570-ada7-034d3fc858eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:23.980544 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c476ec-6bd8-4570-ada7-034d3fc858eb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:23.991384 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1259/2543] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:23.995776 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e756c-4dbc-48dc-bf0f-1f08566e17ff admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:24.006491 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e756c-4dbc-48dc-bf0f-1f08566e17ff admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:24.012081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62048495-32b5-4982-9314-76d1e7adae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:24.012744 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62048495-32b5-4982-9314-76d1e7adae3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:24.013862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62048495-32b5-4982-9314-76d1e7adae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:24.013862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62048495-32b5-4982-9314-76d1e7adae3a admin admin] PATH_INFO: `/v3/projects/994f0ec09445440998728eb997aeb979/users/4bc4a22e3a614d28af8a3154af429a4a/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:24.031031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62048495-32b5-4982-9314-76d1e7adae3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=994f0ec09445440998728eb997aeb979, user_id=4bc4a22e3a614d28af8a3154af429a4a, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:24.033808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62048495-32b5-4982-9314-76d1e7adae3a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:24.144153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1285/2544] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:23 2022] PUT /identity/v3/projects/994f0ec09445440998728eb997aeb979/users/4bc4a22e3a614d28af8a3154af429a4a/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:24.154674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322fc91-00b6-4185-8fe9-a49c02e46cc0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:24.154966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322fc91-00b6-4185-8fe9-a49c02e46cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:24.155295 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322fc91-00b6-4185-8fe9-a49c02e46cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:24.185903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3322fc91-00b6-4185-8fe9-a49c02e46cc0 None None] MFA Rules not processed for user `4bc4a22e3a614d28af8a3154af429a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:24.187273 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3322fc91-00b6-4185-8fe9-a49c02e46cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:24.254526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1260/2545] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:24.259133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62048495-32b5-4982-9314-76d1e7adae3a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:24.322186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62048495-32b5-4982-9314-76d1e7adae3a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:24.327343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932bd43-7be3-44ab-be31-b7363e611c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:24.333736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932bd43-7be3-44ab-be31-b7363e611c96 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:24.333736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932bd43-7be3-44ab-be31-b7363e611c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:24.333736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932bd43-7be3-44ab-be31-b7363e611c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:24.333736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932bd43-7be3-44ab-be31-b7363e611c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:24.333736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932bd43-7be3-44ab-be31-b7363e611c96 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:24.450930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1286/2546] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:24 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:24.455715 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322fc91-00b6-4185-8fe9-a49c02e46cc0 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:24.466773 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322fc91-00b6-4185-8fe9-a49c02e46cc0 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:24.523712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3811a-0167-4327-81e4-1c46da573ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:24.524562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3811a-0167-4327-81e4-1c46da573ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:24.525044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3811a-0167-4327-81e4-1c46da573ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:24.525511 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3811a-0167-4327-81e4-1c46da573ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:24.526138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3811a-0167-4327-81e4-1c46da573ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:24.528759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3811a-0167-4327-81e4-1c46da573ed5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:24.645078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1261/2547] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:24 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:24.656845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932bd43-7be3-44ab-be31-b7363e611c96 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:24.667234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932bd43-7be3-44ab-be31-b7363e611c96 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:24.672650 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2254202-5328-431f-bb20-8b1cfca7f315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:24.673287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2254202-5328-431f-bb20-8b1cfca7f315 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:24.673572 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2254202-5328-431f-bb20-8b1cfca7f315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:24.673851 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2254202-5328-431f-bb20-8b1cfca7f315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:24.674500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2254202-5328-431f-bb20-8b1cfca7f315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:24.676153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2254202-5328-431f-bb20-8b1cfca7f315 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:24.691579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1287/2548] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:24.703669 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3811a-0167-4327-81e4-1c46da573ed5 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:24.708644 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3811a-0167-4327-81e4-1c46da573ed5 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:24.713784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e4236-8cf4-48b9-a7f2-c04564cf1faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:24.715016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e4236-8cf4-48b9-a7f2-c04564cf1faf admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:24.720613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e4236-8cf4-48b9-a7f2-c04564cf1faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:24.720613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e4236-8cf4-48b9-a7f2-c04564cf1faf admin admin] PATH_INFO: `/v3/projects/81bac3897b514a899111e53652705460/users/c893332d9eef4a9fab173f2e12f1da9f/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:24.738882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e4236-8cf4-48b9-a7f2-c04564cf1faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bac3897b514a899111e53652705460, user_id=c893332d9eef4a9fab173f2e12f1da9f, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:24.741777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e4236-8cf4-48b9-a7f2-c04564cf1faf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:24.863534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1262/2549] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:24 2022] PUT /identity/v3/projects/81bac3897b514a899111e53652705460/users/c893332d9eef4a9fab173f2e12f1da9f/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:24.868640 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2254202-5328-431f-bb20-8b1cfca7f315 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:24.880081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2254202-5328-431f-bb20-8b1cfca7f315 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:24.945890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1fea7-3c04-4571-a2af-a5d29a2f42a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:24.946513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1fea7-3c04-4571-a2af-a5d29a2f42a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:24.946796 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1fea7-3c04-4571-a2af-a5d29a2f42a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:24.947094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1fea7-3c04-4571-a2af-a5d29a2f42a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:24.947885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1fea7-3c04-4571-a2af-a5d29a2f42a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:24.957306 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1fea7-3c04-4571-a2af-a5d29a2f42a8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:24.961008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1288/2550] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:24.965914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e4236-8cf4-48b9-a7f2-c04564cf1faf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:24.976195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e4236-8cf4-48b9-a7f2-c04564cf1faf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:24.981009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79870b7d-e2ff-4a4a-a189-a5b3f2384dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:24.981649 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79870b7d-e2ff-4a4a-a189-a5b3f2384dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:24.981934 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79870b7d-e2ff-4a4a-a189-a5b3f2384dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:24.982214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79870b7d-e2ff-4a4a-a189-a5b3f2384dd2 admin admin] PATH_INFO: `/v3/projects/81bac3897b514a899111e53652705460/users/c893332d9eef4a9fab173f2e12f1da9f/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:24.984173 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79870b7d-e2ff-4a4a-a189-a5b3f2384dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bac3897b514a899111e53652705460, user_id=c893332d9eef4a9fab173f2e12f1da9f, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:24.987094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79870b7d-e2ff-4a4a-a189-a5b3f2384dd2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:24.997296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1263/2551] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:24 2022] PUT /identity/v3/projects/81bac3897b514a899111e53652705460/users/c893332d9eef4a9fab173f2e12f1da9f/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:25.009102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c456a-9c9a-4805-87f0-8a1db95d28f0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:25.009388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c456a-9c9a-4805-87f0-8a1db95d28f0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:25.009662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c456a-9c9a-4805-87f0-8a1db95d28f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:25.035955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:25.037917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-330c456a-9c9a-4805-87f0-8a1db95d28f0 None None] MFA Rules not processed for user `c893332d9eef4a9fab173f2e12f1da9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:25.039174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-330c456a-9c9a-4805-87f0-8a1db95d28f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:25.131416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1289/2552] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:25.220797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:25.231345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79870b7d-e2ff-4a4a-a189-a5b3f2384dd2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:25.239566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-79870b7d-e2ff-4a4a-a189-a5b3f2384dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:25.297968 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79870b7d-e2ff-4a4a-a189-a5b3f2384dd2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:25.301999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74fdba-ad7b-4a71-ae39-0438b099b7ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:25.302634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74fdba-ad7b-4a71-ae39-0438b099b7ff service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:25.302912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74fdba-ad7b-4a71-ae39-0438b099b7ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:25.303240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74fdba-ad7b-4a71-ae39-0438b099b7ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:25.366071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74fdba-ad7b-4a71-ae39-0438b099b7ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:25.367631 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74fdba-ad7b-4a71-ae39-0438b099b7ff service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:25.378007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1264/2553] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:25.735930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:26.624189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:27.006922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:27.435607 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:27.460502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c456a-9c9a-4805-87f0-8a1db95d28f0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:27.470898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c456a-9c9a-4805-87f0-8a1db95d28f0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:27.474568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f649ada-0860-4b39-81ec-bf046856071d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:27.475229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f649ada-0860-4b39-81ec-bf046856071d service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:27.475555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f649ada-0860-4b39-81ec-bf046856071d service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:27.475796 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f649ada-0860-4b39-81ec-bf046856071d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:27.485772 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f649ada-0860-4b39-81ec-bf046856071d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:27.487255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f649ada-0860-4b39-81ec-bf046856071d service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:27.497068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1290/2554] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:27.898787 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:32.078508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74fdba-ad7b-4a71-ae39-0438b099b7ff service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:32.153174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74fdba-ad7b-4a71-ae39-0438b099b7ff service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:32.157933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:32.159081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:32.159081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:32.159569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] PATH_INFO: `/v3/users/4bc4a22e3a614d28af8a3154af429a4a` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:32.160725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc4a22e3a614d28af8a3154af429a4a)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:32.163329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:32.392620 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc4a22e3a614d28af8a3154af429a4a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:32.486287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc4a22e3a614d28af8a3154af429a4a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:32.495338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc4a22e3a614d28af8a3154af429a4a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:32.496145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc4a22e3a614d28af8a3154af429a4a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:32.509462 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc4a22e3a614d28af8a3154af429a4a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:32.516675 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1265/2555] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:32 2022] DELETE /identity/v3/users/4bc4a22e3a614d28af8a3154af429a4a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:32.521378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eedf1c-fa13-4819-affe-d8f2a2c952f0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:32.522311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eedf1c-fa13-4819-affe-d8f2a2c952f0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:32.522606 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eedf1c-fa13-4819-affe-d8f2a2c952f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:32.554007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-18eedf1c-fa13-4819-affe-d8f2a2c952f0 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:32.554007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-18eedf1c-fa13-4819-affe-d8f2a2c952f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:32.613091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1291/2556] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:32.623929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:32.625565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:32.686804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4dce5-4978-4747-947e-d1c53a4675bb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:32.690515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a976ec0-52ab-43da-8c89-d499317509a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:32.691157 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976ec0-52ab-43da-8c89-d499317509a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:32.691439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976ec0-52ab-43da-8c89-d499317509a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:32.691712 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976ec0-52ab-43da-8c89-d499317509a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:32.707967 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a976ec0-52ab-43da-8c89-d499317509a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:32.709391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a976ec0-52ab-43da-8c89-d499317509a7 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:32.721069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1266/2557] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:33.163558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eedf1c-fa13-4819-affe-d8f2a2c952f0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.165069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-18eedf1c-fa13-4819-affe-d8f2a2c952f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:33.179255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eedf1c-fa13-4819-affe-d8f2a2c952f0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:33.184337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:33.190024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.190222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.193290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] PATH_INFO: `/v3/projects/994f0ec09445440998728eb997aeb979` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.194648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] RBAC: Authorizing `identity:delete_project(project_id=994f0ec09445440998728eb997aeb979)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:33.196832 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.329714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994f0ec09445440998728eb997aeb979', 'request_id': 'req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:33.333213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:33.412153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994f0ec09445440998728eb997aeb979', 'request_id': 'req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:33.418768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994f0ec09445440998728eb997aeb979', 'request_id': 'req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:33.430194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] The token cache is being invalidate because project 994f0ec09445440998728eb997aeb979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:33.430489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:33.434612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:33.434612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1292/2558] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:33 2022] DELETE /identity/v3/projects/994f0ec09445440998728eb997aeb979 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:33.437317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a976ec0-52ab-43da-8c89-d499317509a7 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.442512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:33.447973 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a976ec0-52ab-43da-8c89-d499317509a7 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:33.508869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a15ed4-c8d5-4b95-9cf7-2fb49ba95346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:33.509506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a15ed4-c8d5-4b95-9cf7-2fb49ba95346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.509794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a15ed4-c8d5-4b95-9cf7-2fb49ba95346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.510075 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a15ed4-c8d5-4b95-9cf7-2fb49ba95346 admin admin] PATH_INFO: `/v3/users/c893332d9eef4a9fab173f2e12f1da9f` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.511388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a15ed4-c8d5-4b95-9cf7-2fb49ba95346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c893332d9eef4a9fab173f2e12f1da9f)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:33.513379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a15ed4-c8d5-4b95-9cf7-2fb49ba95346 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.679547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.681073 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:33.702438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642c86e-5bcf-4b7b-abd7-e70b54fa611f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:33.708263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:33.709332 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.709645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.710053 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] PATH_INFO: `/v3/users/104847bca2e5456c84a631f22823c8a9` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.711604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=104847bca2e5456c84a631f22823c8a9)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:33.717915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.733976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-22a15ed4-c8d5-4b95-9cf7-2fb49ba95346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c893332d9eef4a9fab173f2e12f1da9f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:33.886623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-22a15ed4-c8d5-4b95-9cf7-2fb49ba95346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c893332d9eef4a9fab173f2e12f1da9f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:33.894689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-22a15ed4-c8d5-4b95-9cf7-2fb49ba95346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c893332d9eef4a9fab173f2e12f1da9f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:33.895397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-22a15ed4-c8d5-4b95-9cf7-2fb49ba95346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c893332d9eef4a9fab173f2e12f1da9f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:33.908149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-22a15ed4-c8d5-4b95-9cf7-2fb49ba95346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c893332d9eef4a9fab173f2e12f1da9f'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:33.914054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1267/2559] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:33 2022] DELETE /identity/v3/users/c893332d9eef4a9fab173f2e12f1da9f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:34.277695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104847bca2e5456c84a631f22823c8a9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:34.278466 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104847bca2e5456c84a631f22823c8a9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:34.279199 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104847bca2e5456c84a631f22823c8a9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:34.393030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104847bca2e5456c84a631f22823c8a9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:34.413815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104847bca2e5456c84a631f22823c8a9'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:34.436481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1293/2560] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:33 2022] DELETE /identity/v3/users/104847bca2e5456c84a631f22823c8a9 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:34.442744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fea3c-0272-4969-8521-792afcb51be8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:34.443266 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fea3c-0272-4969-8521-792afcb51be8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:34.443536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fea3c-0272-4969-8521-792afcb51be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:34.464782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-175fea3c-0272-4969-8521-792afcb51be8 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:34.466048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-175fea3c-0272-4969-8521-792afcb51be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:34.526557 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1268/2561] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:34.538525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:34.540003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:34.562903 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fea3c-0272-4969-8521-792afcb51be8 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:34.568945 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-175fea3c-0272-4969-8521-792afcb51be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:34.581299 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fea3c-0272-4969-8521-792afcb51be8 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:34.587949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:34.593051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:34.593051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:34.593051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] PATH_INFO: `/v3/projects/81bac3897b514a899111e53652705460` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:34.593051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81bac3897b514a899111e53652705460)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:34.593519 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:34.620870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:34.622508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d2b47-9a99-4de0-8239-52cd2821daf5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:34.626164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d03cb0-5167-4db8-8d0f-370cebec7b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:34.626813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d03cb0-5167-4db8-8d0f-370cebec7b23 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:34.627166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d03cb0-5167-4db8-8d0f-370cebec7b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:34.627472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d03cb0-5167-4db8-8d0f-370cebec7b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:34.637217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d03cb0-5167-4db8-8d0f-370cebec7b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:34.638731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d03cb0-5167-4db8-8d0f-370cebec7b23 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:34.648281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1294/2562] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:34.710549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81bac3897b514a899111e53652705460', 'request_id': 'req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:34.716260 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81bac3897b514a899111e53652705460', 'request_id': 'req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:34.789039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81bac3897b514a899111e53652705460', 'request_id': 'req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:34.803570 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] The token cache is being invalidate because project 81bac3897b514a899111e53652705460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:34.803864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:34.804535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8764340c-dfd9-4c2a-b8d9-d0958b1c9747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:34.806048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1269/2563] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:34 2022] DELETE /identity/v3/projects/81bac3897b514a899111e53652705460 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:34.817093 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a789e8c-0555-4a81-85aa-37c7327dcb2b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:34.817612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a789e8c-0555-4a81-85aa-37c7327dcb2b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:34.818089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a789e8c-0555-4a81-85aa-37c7327dcb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:34.838440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2a789e8c-0555-4a81-85aa-37c7327dcb2b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:34.839679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2a789e8c-0555-4a81-85aa-37c7327dcb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:34.895846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:34.908220 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1295/2564] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:34.916287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9f69-6516-4cef-9980-ffbe848294d4 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:34.916842 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9f69-6516-4cef-9980-ffbe848294d4 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:34.917773 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d9f69-6516-4cef-9980-ffbe848294d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:34.942351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-1a2d9f69-6516-4cef-9980-ffbe848294d4 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:34.944000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-1a2d9f69-6516-4cef-9980-ffbe848294d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:34.954620 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1270/2565] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:34.958542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a789e8c-0555-4a81-85aa-37c7327dcb2b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:34.969730 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a789e8c-0555-4a81-85aa-37c7327dcb2b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:34.974570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47175e7-8ea5-4bfe-a952-d309c3f14b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:34.975230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47175e7-8ea5-4bfe-a952-d309c3f14b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:34.978659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47175e7-8ea5-4bfe-a952-d309c3f14b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:34.978659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47175e7-8ea5-4bfe-a952-d309c3f14b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:34.978659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47175e7-8ea5-4bfe-a952-d309c3f14b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:34.978659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47175e7-8ea5-4bfe-a952-d309c3f14b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:34.978659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47175e7-8ea5-4bfe-a952-d309c3f14b3b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:34.991254 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1296/2566] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:55:34.995626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d9f69-6516-4cef-9980-ffbe848294d4 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:35.005205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d9f69-6516-4cef-9980-ffbe848294d4 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:35.010121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1062e4f-0856-444f-a4b1-19c09c348893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:35.011639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1062e4f-0856-444f-a4b1-19c09c348893 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.011639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1062e4f-0856-444f-a4b1-19c09c348893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.011639 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1062e4f-0856-444f-a4b1-19c09c348893 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.012287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1062e4f-0856-444f-a4b1-19c09c348893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:35.014329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1062e4f-0856-444f-a4b1-19c09c348893 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:35.120773 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1271/2567] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:34 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:35.124751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47175e7-8ea5-4bfe-a952-d309c3f14b3b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:35.134746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47175e7-8ea5-4bfe-a952-d309c3f14b3b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:35.174861 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1062e4f-0856-444f-a4b1-19c09c348893 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:35.179436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c1062e4f-0856-444f-a4b1-19c09c348893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:35.224747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939e618-9244-48c9-b5e3-5da002ecdec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:35.225534 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939e618-9244-48c9-b5e3-5da002ecdec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.225908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939e618-9244-48c9-b5e3-5da002ecdec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.226284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939e618-9244-48c9-b5e3-5da002ecdec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.227020 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939e618-9244-48c9-b5e3-5da002ecdec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:35.229088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939e618-9244-48c9-b5e3-5da002ecdec3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:35.264993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1062e4f-0856-444f-a4b1-19c09c348893 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:35.270043 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:35.270707 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.270993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.271303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] PATH_INFO: `/v3/projects/b76c099d966e4421ae576bf01e1dcb75` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.278069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76c099d966e4421ae576bf01e1dcb75)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:35.278069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:35.372521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1297/2568] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:35 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:35.376490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939e618-9244-48c9-b5e3-5da002ecdec3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:35.386610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939e618-9244-48c9-b5e3-5da002ecdec3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:35.391843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac754c-1af5-4d90-957b-8a6ec2fa5f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:35.392427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac754c-1af5-4d90-957b-8a6ec2fa5f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.392747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac754c-1af5-4d90-957b-8a6ec2fa5f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.393067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac754c-1af5-4d90-957b-8a6ec2fa5f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.393714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac754c-1af5-4d90-957b-8a6ec2fa5f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:35.395392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac754c-1af5-4d90-957b-8a6ec2fa5f12 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:35.406873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1298/2569] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:35.410614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac754c-1af5-4d90-957b-8a6ec2fa5f12 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:35.420190 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac754c-1af5-4d90-957b-8a6ec2fa5f12 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:35.425033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a52da-aa62-43d3-acd6-cb6b949b5512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:35.425628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a52da-aa62-43d3-acd6-cb6b949b5512 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.425911 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a52da-aa62-43d3-acd6-cb6b949b5512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.426184 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a52da-aa62-43d3-acd6-cb6b949b5512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.426827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a52da-aa62-43d3-acd6-cb6b949b5512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:35.428542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a52da-aa62-43d3-acd6-cb6b949b5512 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:35.435589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76c099d966e4421ae576bf01e1dcb75', 'request_id': 'req-3216dc09-2d37-48ff-b514-4570a1d5b479'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:35.442263 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1299/2570] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:35.443370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a52da-aa62-43d3-acd6-cb6b949b5512 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:35.445365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76c099d966e4421ae576bf01e1dcb75', 'request_id': 'req-3216dc09-2d37-48ff-b514-4570a1d5b479'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:35.454180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a52da-aa62-43d3-acd6-cb6b949b5512 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:35.509210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c403d2-a3ba-4187-ae88-0bee02b2065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:35.509866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c403d2-a3ba-4187-ae88-0bee02b2065d admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.510155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c403d2-a3ba-4187-ae88-0bee02b2065d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.510435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c403d2-a3ba-4187-ae88-0bee02b2065d admin admin] PATH_INFO: `/v3/projects/73510102f35a474ca0f67d332d300471/users/df1998639e0649bab7d7c9caa7a6ec6c/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.526821 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c403d2-a3ba-4187-ae88-0bee02b2065d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73510102f35a474ca0f67d332d300471, user_id=df1998639e0649bab7d7c9caa7a6ec6c, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:35.529658 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c403d2-a3ba-4187-ae88-0bee02b2065d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:35.543217 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76c099d966e4421ae576bf01e1dcb75', 'request_id': 'req-3216dc09-2d37-48ff-b514-4570a1d5b479'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:35.554784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] The token cache is being invalidate because project b76c099d966e4421ae576bf01e1dcb75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:35.555107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:35.555763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3216dc09-2d37-48ff-b514-4570a1d5b479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:35.557300 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1272/2571] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:35 2022] DELETE /identity/v3/projects/b76c099d966e4421ae576bf01e1dcb75 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:35.562995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358751-4344-4e6c-bd1f-197559f1fd2c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.563340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358751-4344-4e6c-bd1f-197559f1fd2c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.563627 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358751-4344-4e6c-bd1f-197559f1fd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.584246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-66358751-4344-4e6c-bd1f-197559f1fd2c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:35.585486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-66358751-4344-4e6c-bd1f-197559f1fd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:35.596255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1273/2572] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:35.667743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6482275-22bd-4cd2-a15f-04e1eab50fa2 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.668069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6482275-22bd-4cd2-a15f-04e1eab50fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.668333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6482275-22bd-4cd2-a15f-04e1eab50fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.693102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a6482275-22bd-4cd2-a15f-04e1eab50fa2 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:35.694604 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a6482275-22bd-4cd2-a15f-04e1eab50fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:35.704076 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1274/2573] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:35.708314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6482275-22bd-4cd2-a15f-04e1eab50fa2 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:35.717884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6482275-22bd-4cd2-a15f-04e1eab50fa2 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:35.720577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1300/2574] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:35 2022] PUT /identity/v3/projects/73510102f35a474ca0f67d332d300471/users/df1998639e0649bab7d7c9caa7a6ec6c/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:35.740228 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cee20-89b4-40d7-aba4-e50dcc8394fc None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.740524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cee20-89b4-40d7-aba4-e50dcc8394fc None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.740806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cee20-89b4-40d7-aba4-e50dcc8394fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.771233 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-af4cee20-89b4-40d7-aba4-e50dcc8394fc None None] MFA Rules not processed for user `df1998639e0649bab7d7c9caa7a6ec6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:35.772540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-af4cee20-89b4-40d7-aba4-e50dcc8394fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:35.779308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f48e94-5f90-482d-b45a-c85612a65d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:35.779929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48e94-5f90-482d-b45a-c85612a65d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.780214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48e94-5f90-482d-b45a-c85612a65d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.780492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48e94-5f90-482d-b45a-c85612a65d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.781284 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f48e94-5f90-482d-b45a-c85612a65d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:35.781597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f48e94-5f90-482d-b45a-c85612a65d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:35.783259 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f48e94-5f90-482d-b45a-c85612a65d93 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:35.798444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1275/2575] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:55:35.799572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f48e94-5f90-482d-b45a-c85612a65d93 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:35.809911 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f48e94-5f90-482d-b45a-c85612a65d93 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:35.816853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf9909-bd0b-412c-b3f8-f02bd8ed7f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:35.817507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf9909-bd0b-412c-b3f8-f02bd8ed7f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.817791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf9909-bd0b-412c-b3f8-f02bd8ed7f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.818068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf9909-bd0b-412c-b3f8-f02bd8ed7f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.818761 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf9909-bd0b-412c-b3f8-f02bd8ed7f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:35.820767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf9909-bd0b-412c-b3f8-f02bd8ed7f1b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:35.839838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1301/2576] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:35.844898 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cee20-89b4-40d7-aba4-e50dcc8394fc None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:35.846311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-af4cee20-89b4-40d7-aba4-e50dcc8394fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:35.860545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cee20-89b4-40d7-aba4-e50dcc8394fc None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:35.865710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e3cd-a241-4203-aac3-a58fe18bb50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:35.877207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e3cd-a241-4203-aac3-a58fe18bb50a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:35.877207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e3cd-a241-4203-aac3-a58fe18bb50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:35.877207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e3cd-a241-4203-aac3-a58fe18bb50a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:35.877207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52e3cd-a241-4203-aac3-a58fe18bb50a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:35.877207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52e3cd-a241-4203-aac3-a58fe18bb50a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.033430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1276/2577] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:35 2022] POST /identity/v3/projects => generated 399 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:36.033651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1302/2578] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:35 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:36.040137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf9909-bd0b-412c-b3f8-f02bd8ed7f1b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:36.040294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e3cd-a241-4203-aac3-a58fe18bb50a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:36.079919 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:36.106590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e3cd-a241-4203-aac3-a58fe18bb50a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:36.108235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf9909-bd0b-412c-b3f8-f02bd8ed7f1b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:36.111358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac7161-bf25-4742-88cf-33c15dbc1beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:36.111977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7161-bf25-4742-88cf-33c15dbc1beb admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.112261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7161-bf25-4742-88cf-33c15dbc1beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.112538 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7161-bf25-4742-88cf-33c15dbc1beb admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.113041 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688a6e8-8b89-4648-ad10-c005da7c8a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:36.113211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac7161-bf25-4742-88cf-33c15dbc1beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:36.113718 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688a6e8-8b89-4648-ad10-c005da7c8a7a admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.114082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688a6e8-8b89-4648-ad10-c005da7c8a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.114414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688a6e8-8b89-4648-ad10-c005da7c8a7a admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.115093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688a6e8-8b89-4648-ad10-c005da7c8a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:36.115227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac7161-bf25-4742-88cf-33c15dbc1beb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.117105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688a6e8-8b89-4648-ad10-c005da7c8a7a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.205780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1303/2579] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:36 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:36.211000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac7161-bf25-4742-88cf-33c15dbc1beb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:36.221707 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac7161-bf25-4742-88cf-33c15dbc1beb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:36.226895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f60c1-5103-4215-b8d6-051cbbf3b404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:36.227544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f60c1-5103-4215-b8d6-051cbbf3b404 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.227867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f60c1-5103-4215-b8d6-051cbbf3b404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.228103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f60c1-5103-4215-b8d6-051cbbf3b404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.228900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f60c1-5103-4215-b8d6-051cbbf3b404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:36.230493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f60c1-5103-4215-b8d6-051cbbf3b404 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.235167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1277/2580] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:36 2022] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:36.243839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1304/2581] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:36.251748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688a6e8-8b89-4648-ad10-c005da7c8a7a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:36.251871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f60c1-5103-4215-b8d6-051cbbf3b404 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:36.263190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688a6e8-8b89-4648-ad10-c005da7c8a7a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:36.268488 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33304-fe9b-416b-8750-9fa19ef2dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:36.269567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33304-fe9b-416b-8750-9fa19ef2dc33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.271941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f60c1-5103-4215-b8d6-051cbbf3b404 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:36.272101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33304-fe9b-416b-8750-9fa19ef2dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.272101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33304-fe9b-416b-8750-9fa19ef2dc33 admin admin] PATH_INFO: `/v3/projects/6e5f1ee0f6bd4e1585b83c9ca3919627/users/b9c477d355134179949a3d17a68b74df/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.276068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9fbd8-bc5d-45f3-814a-f1c25500b03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:36.277367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9fbd8-bc5d-45f3-814a-f1c25500b03a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.277719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9fbd8-bc5d-45f3-814a-f1c25500b03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.278072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9fbd8-bc5d-45f3-814a-f1c25500b03a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.278863 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9fbd8-bc5d-45f3-814a-f1c25500b03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:36.280660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9fbd8-bc5d-45f3-814a-f1c25500b03a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.290555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae33304-fe9b-416b-8750-9fa19ef2dc33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5f1ee0f6bd4e1585b83c9ca3919627, user_id=b9c477d355134179949a3d17a68b74df, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:36.293500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae33304-fe9b-416b-8750-9fa19ef2dc33 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.294322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1305/2582] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:36.298532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9fbd8-bc5d-45f3-814a-f1c25500b03a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:36.308839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9fbd8-bc5d-45f3-814a-f1c25500b03a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:36.313654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb5dd-94bd-4a0f-a2ef-dafc1aba3df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:36.314411 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb5dd-94bd-4a0f-a2ef-dafc1aba3df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.314593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb5dd-94bd-4a0f-a2ef-dafc1aba3df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.314869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb5dd-94bd-4a0f-a2ef-dafc1aba3df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.315569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cb5dd-94bd-4a0f-a2ef-dafc1aba3df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:36.317265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cb5dd-94bd-4a0f-a2ef-dafc1aba3df5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.328765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1306/2583] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:36.333030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb5dd-94bd-4a0f-a2ef-dafc1aba3df5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:36.343567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb5dd-94bd-4a0f-a2ef-dafc1aba3df5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:36.348820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39f720-3ac7-4ac8-9c1e-9ffe06968f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:36.349504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39f720-3ac7-4ac8-9c1e-9ffe06968f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.349782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39f720-3ac7-4ac8-9c1e-9ffe06968f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.350060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39f720-3ac7-4ac8-9c1e-9ffe06968f4b admin admin] PATH_INFO: `/v3/projects/025c2cee8ad44e7b9cf716dd9377d369/users/1dfe0b3989d8450f842fd73d1fc99886/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.365941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39f720-3ac7-4ac8-9c1e-9ffe06968f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=025c2cee8ad44e7b9cf716dd9377d369, user_id=1dfe0b3989d8450f842fd73d1fc99886, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:36.368686 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39f720-3ac7-4ac8-9c1e-9ffe06968f4b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.374689 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1278/2584] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:36 2022] PUT /identity/v3/projects/6e5f1ee0f6bd4e1585b83c9ca3919627/users/b9c477d355134179949a3d17a68b74df/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:36.378486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33304-fe9b-416b-8750-9fa19ef2dc33 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:36.398381 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:36.440162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33304-fe9b-416b-8750-9fa19ef2dc33 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:36.445057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2735a1-68ab-401d-80d4-da8fa0f60558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:36.445691 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2735a1-68ab-401d-80d4-da8fa0f60558 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.446275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2735a1-68ab-401d-80d4-da8fa0f60558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.446275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2735a1-68ab-401d-80d4-da8fa0f60558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.446840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2735a1-68ab-401d-80d4-da8fa0f60558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:36.449319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2735a1-68ab-401d-80d4-da8fa0f60558 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.458756 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1307/2585] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:36 2022] PUT /identity/v3/projects/025c2cee8ad44e7b9cf716dd9377d369/users/1dfe0b3989d8450f842fd73d1fc99886/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:36.461473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1279/2586] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:36.465495 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39f720-3ac7-4ac8-9c1e-9ffe06968f4b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:36.468966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e1b39-da45-4942-82eb-2a60f782286f None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.469262 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e1b39-da45-4942-82eb-2a60f782286f None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.469543 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e1b39-da45-4942-82eb-2a60f782286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.501113 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c75e1b39-da45-4942-82eb-2a60f782286f None None] MFA Rules not processed for user `1dfe0b3989d8450f842fd73d1fc99886`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:36.502493 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c75e1b39-da45-4942-82eb-2a60f782286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:36.534145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39f720-3ac7-4ac8-9c1e-9ffe06968f4b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:36.539156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28535aa-ad47-47e8-8313-e2929ea347f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:36.539944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28535aa-ad47-47e8-8313-e2929ea347f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.540374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28535aa-ad47-47e8-8313-e2929ea347f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.540736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28535aa-ad47-47e8-8313-e2929ea347f6 admin admin] PATH_INFO: `/v3/projects/6e5f1ee0f6bd4e1585b83c9ca3919627/users/b9c477d355134179949a3d17a68b74df/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.542950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28535aa-ad47-47e8-8313-e2929ea347f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5f1ee0f6bd4e1585b83c9ca3919627, user_id=b9c477d355134179949a3d17a68b74df, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:36.545970 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28535aa-ad47-47e8-8313-e2929ea347f6 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.556758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1308/2587] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:36 2022] PUT /identity/v3/projects/6e5f1ee0f6bd4e1585b83c9ca3919627/users/b9c477d355134179949a3d17a68b74df/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:36.569447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1280/2588] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:36.576194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a47d7-96d7-46b8-b83d-2a955e921e3c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.576485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a47d7-96d7-46b8-b83d-2a955e921e3c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.576762 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a47d7-96d7-46b8-b83d-2a955e921e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.581630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e1b39-da45-4942-82eb-2a60f782286f None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:36.583184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c75e1b39-da45-4942-82eb-2a60f782286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:36.608325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-993a47d7-96d7-46b8-b83d-2a955e921e3c None None] MFA Rules not processed for user `b9c477d355134179949a3d17a68b74df`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:36.609625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-993a47d7-96d7-46b8-b83d-2a955e921e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:36.645826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e1b39-da45-4942-82eb-2a60f782286f None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:36.680072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1309/2589] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:36.700038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5db40a-64ed-4bcc-9b29-47ecf927509b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:36.700638 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5db40a-64ed-4bcc-9b29-47ecf927509b service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.700914 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5db40a-64ed-4bcc-9b29-47ecf927509b service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.701184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5db40a-64ed-4bcc-9b29-47ecf927509b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.769993 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5db40a-64ed-4bcc-9b29-47ecf927509b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:36.771409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5db40a-64ed-4bcc-9b29-47ecf927509b service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.780468 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1281/2590] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:36.798977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:36.809922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a47d7-96d7-46b8-b83d-2a955e921e3c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:36.819947 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a47d7-96d7-46b8-b83d-2a955e921e3c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:36.824016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f464826-bf89-4029-ae0a-2ac933991987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:36.824622 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f464826-bf89-4029-ae0a-2ac933991987 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:36.829478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f464826-bf89-4029-ae0a-2ac933991987 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:36.829478 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f464826-bf89-4029-ae0a-2ac933991987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:36.834276 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f464826-bf89-4029-ae0a-2ac933991987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:36.835803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f464826-bf89-4029-ae0a-2ac933991987 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:36.845754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1310/2591] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:36.882501 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:37.102929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5db40a-64ed-4bcc-9b29-47ecf927509b service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:37.117192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5db40a-64ed-4bcc-9b29-47ecf927509b service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:37.122452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91ae4d-2a33-4ac1-b4d7-317e17273ea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:37.123130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91ae4d-2a33-4ac1-b4d7-317e17273ea9 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:37.123412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91ae4d-2a33-4ac1-b4d7-317e17273ea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:37.123716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91ae4d-2a33-4ac1-b4d7-317e17273ea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:37.183094 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91ae4d-2a33-4ac1-b4d7-317e17273ea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:37.184568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91ae4d-2a33-4ac1-b4d7-317e17273ea9 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:37.193889 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1282/2592] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:37.360899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:41.383122 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f464826-bf89-4029-ae0a-2ac933991987 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:41.385882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1f464826-bf89-4029-ae0a-2ac933991987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:41.451608 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f464826-bf89-4029-ae0a-2ac933991987 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:41.456469 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:41.457105 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:41.457385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:41.457661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] PATH_INFO: `/v3/users/281f85200da644e8bd9ca6bb3b6a6b6c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:41.458807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281f85200da644e8bd9ca6bb3b6a6b6c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:41.460778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:41.683340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:41.689290 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281f85200da644e8bd9ca6bb3b6a6b6c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:41.689985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281f85200da644e8bd9ca6bb3b6a6b6c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:41.690661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281f85200da644e8bd9ca6bb3b6a6b6c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:41.844339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281f85200da644e8bd9ca6bb3b6a6b6c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:41.861980 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281f85200da644e8bd9ca6bb3b6a6b6c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:41.888590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1311/2593] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:41 2022] DELETE /identity/v3/users/281f85200da644e8bd9ca6bb3b6a6b6c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:41.893044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af911883-ef6e-4aa1-968d-5bb34399f79b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:41.893913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af911883-ef6e-4aa1-968d-5bb34399f79b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:41.894447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af911883-ef6e-4aa1-968d-5bb34399f79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:41.921096 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-af911883-ef6e-4aa1-968d-5bb34399f79b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:41.922590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-af911883-ef6e-4aa1-968d-5bb34399f79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:42.014078 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1283/2594] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:42.021160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:42.030666 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:42.101203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09bdd-3f89-42f7-b851-082fc71a6c74 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:42.105390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1dee0-1f8b-4fc4-b1c1-e564cf2557a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:42.106002 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1dee0-1f8b-4fc4-b1c1-e564cf2557a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:42.106284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1dee0-1f8b-4fc4-b1c1-e564cf2557a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:42.106593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1dee0-1f8b-4fc4-b1c1-e564cf2557a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:42.116334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1dee0-1f8b-4fc4-b1c1-e564cf2557a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:42.117788 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1dee0-1f8b-4fc4-b1c1-e564cf2557a6 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:42.130234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1312/2595] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:42.693021 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af911883-ef6e-4aa1-968d-5bb34399f79b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:42.694512 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-af911883-ef6e-4aa1-968d-5bb34399f79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:42.708481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af911883-ef6e-4aa1-968d-5bb34399f79b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:42.713365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:42.714010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:42.719252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:42.719252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] PATH_INFO: `/v3/projects/2e9af643bb404cc0ad865db36398ed8b` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:42.719252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9af643bb404cc0ad865db36398ed8b)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:42.719252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:42.853057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9af643bb404cc0ad865db36398ed8b', 'request_id': 'req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:42.859681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9af643bb404cc0ad865db36398ed8b', 'request_id': 'req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:42.862255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:42.955062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9af643bb404cc0ad865db36398ed8b', 'request_id': 'req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:42.967797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] The token cache is being invalidate because project 2e9af643bb404cc0ad865db36398ed8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:42.968092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:42.968748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:42.970268 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1284/2596] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:42 2022] DELETE /identity/v3/projects/2e9af643bb404cc0ad865db36398ed8b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:42.974491 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1dee0-1f8b-4fc4-b1c1-e564cf2557a6 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:42.986118 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1dee0-1f8b-4fc4-b1c1-e564cf2557a6 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:43.044378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f35e3-2f42-4f15-b2bf-4e6f06d56e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:43.045024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f35e3-2f42-4f15-b2bf-4e6f06d56e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:43.045316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f35e3-2f42-4f15-b2bf-4e6f06d56e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:43.045595 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f35e3-2f42-4f15-b2bf-4e6f06d56e1a admin admin] PATH_INFO: `/v3/users/929df4f969f24b42bdba7d89068b377f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:43.046727 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f35e3-2f42-4f15-b2bf-4e6f06d56e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=929df4f969f24b42bdba7d89068b377f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:43.048717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f35e3-2f42-4f15-b2bf-4e6f06d56e1a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:43.431521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b99f35e3-2f42-4f15-b2bf-4e6f06d56e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929df4f969f24b42bdba7d89068b377f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:43.432241 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b99f35e3-2f42-4f15-b2bf-4e6f06d56e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929df4f969f24b42bdba7d89068b377f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:43.432886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b99f35e3-2f42-4f15-b2bf-4e6f06d56e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929df4f969f24b42bdba7d89068b377f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:43.531370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b99f35e3-2f42-4f15-b2bf-4e6f06d56e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929df4f969f24b42bdba7d89068b377f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:43.539566 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:43.545284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b99f35e3-2f42-4f15-b2bf-4e6f06d56e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929df4f969f24b42bdba7d89068b377f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:43.558488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1313/2597] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:42 2022] DELETE /identity/v3/users/929df4f969f24b42bdba7d89068b377f => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:44.098086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:44.099581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:44.115645 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5301b64-2c1c-43f7-a8b4-cd4781c263f3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:44.186016 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:44.186716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:44.187006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:44.187395 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] PATH_INFO: `/v3/projects/f7871bbea2c94f19814028196e8ebf90` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:44.188439 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7871bbea2c94f19814028196e8ebf90)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:44.190453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:44.392112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7871bbea2c94f19814028196e8ebf90', 'request_id': 'req-e53189a3-8d16-41d6-b028-35dbf2a5392a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:44.397736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7871bbea2c94f19814028196e8ebf90', 'request_id': 'req-e53189a3-8d16-41d6-b028-35dbf2a5392a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:44.510788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7871bbea2c94f19814028196e8ebf90', 'request_id': 'req-e53189a3-8d16-41d6-b028-35dbf2a5392a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:44.522195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] The token cache is being invalidate because project f7871bbea2c94f19814028196e8ebf90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:44.522504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:44.523188 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e53189a3-8d16-41d6-b028-35dbf2a5392a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:44.524992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1285/2598] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:44 2022] DELETE /identity/v3/projects/f7871bbea2c94f19814028196e8ebf90 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:44.530037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77bd35-e540-48f5-8215-de233d136562 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:44.530579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77bd35-e540-48f5-8215-de233d136562 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:44.531145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77bd35-e540-48f5-8215-de233d136562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:44.554058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7a77bd35-e540-48f5-8215-de233d136562 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:44.555247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7a77bd35-e540-48f5-8215-de233d136562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:44.617148 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1314/2599] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:44.625706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf04429-d7de-4300-9bdb-55a55a7fe440 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:44.626010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf04429-d7de-4300-9bdb-55a55a7fe440 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:44.626292 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf04429-d7de-4300-9bdb-55a55a7fe440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:44.646316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-edf04429-d7de-4300-9bdb-55a55a7fe440 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:44.647687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-edf04429-d7de-4300-9bdb-55a55a7fe440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:44.656725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1286/2600] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:44.661061 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77bd35-e540-48f5-8215-de233d136562 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:44.671645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77bd35-e540-48f5-8215-de233d136562 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:44.677154 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a89f15-2c29-4552-aa28-e0c5e253fdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:44.677769 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a89f15-2c29-4552-aa28-e0c5e253fdef admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:44.678048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a89f15-2c29-4552-aa28-e0c5e253fdef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:44.678318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a89f15-2c29-4552-aa28-e0c5e253fdef admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:44.679038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a89f15-2c29-4552-aa28-e0c5e253fdef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:44.679378 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a89f15-2c29-4552-aa28-e0c5e253fdef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:44.684296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a89f15-2c29-4552-aa28-e0c5e253fdef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:44.693221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1315/2601] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:55:44.697788 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf04429-d7de-4300-9bdb-55a55a7fe440 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:44.707444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf04429-d7de-4300-9bdb-55a55a7fe440 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:44.712470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6552f9-3d6c-4fd2-9a33-73d537f8bb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:44.713138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6552f9-3d6c-4fd2-9a33-73d537f8bb5f admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:44.714025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6552f9-3d6c-4fd2-9a33-73d537f8bb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:44.714296 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6552f9-3d6c-4fd2-9a33-73d537f8bb5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:44.715330 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6552f9-3d6c-4fd2-9a33-73d537f8bb5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:44.717774 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6552f9-3d6c-4fd2-9a33-73d537f8bb5f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:44.736964 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a89f15-2c29-4552-aa28-e0c5e253fdef admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:44.744722 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-90a89f15-2c29-4552-aa28-e0c5e253fdef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:44.757540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a89f15-2c29-4552-aa28-e0c5e253fdef admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:44.762430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e8b08-a793-489f-bf80-007f6c12d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:44.763086 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e8b08-a793-489f-bf80-007f6c12d1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:44.763373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e8b08-a793-489f-bf80-007f6c12d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:44.763653 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e8b08-a793-489f-bf80-007f6c12d1dc admin admin] PATH_INFO: `/v3/users/1dfe0b3989d8450f842fd73d1fc99886` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:44.764807 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e8b08-a793-489f-bf80-007f6c12d1dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dfe0b3989d8450f842fd73d1fc99886)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:44.766751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e8b08-a793-489f-bf80-007f6c12d1dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:44.949414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1287/2602] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:44 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:44.950609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6552f9-3d6c-4fd2-9a33-73d537f8bb5f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:45.029610 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:45.041698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6552f9-3d6c-4fd2-9a33-73d537f8bb5f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:45.046885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38ee9d-b4bb-4bda-8d4e-a1d2badb3b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:45.047629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38ee9d-b4bb-4bda-8d4e-a1d2badb3b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:45.048128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38ee9d-b4bb-4bda-8d4e-a1d2badb3b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:45.048566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38ee9d-b4bb-4bda-8d4e-a1d2badb3b73 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:45.049279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38ee9d-b4bb-4bda-8d4e-a1d2badb3b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:45.053457 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38ee9d-b4bb-4bda-8d4e-a1d2badb3b73 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:45.074603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a42e8b08-a793-489f-bf80-007f6c12d1dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dfe0b3989d8450f842fd73d1fc99886'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:45.075806 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a42e8b08-a793-489f-bf80-007f6c12d1dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dfe0b3989d8450f842fd73d1fc99886'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:45.076888 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a42e8b08-a793-489f-bf80-007f6c12d1dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dfe0b3989d8450f842fd73d1fc99886'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:45.164382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a42e8b08-a793-489f-bf80-007f6c12d1dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dfe0b3989d8450f842fd73d1fc99886'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:45.172513 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1288/2603] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:44 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:45.182404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a42e8b08-a793-489f-bf80-007f6c12d1dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dfe0b3989d8450f842fd73d1fc99886'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:45.183084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38ee9d-b4bb-4bda-8d4e-a1d2badb3b73 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:45.186027 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-dd38ee9d-b4bb-4bda-8d4e-a1d2badb3b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:45.208464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1316/2604] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:44 2022] DELETE /identity/v3/users/1dfe0b3989d8450f842fd73d1fc99886 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:45.212016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4119708-33cd-4cbc-89ef-2c8b1ccd66ce None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:45.212316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4119708-33cd-4cbc-89ef-2c8b1ccd66ce None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:45.212675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4119708-33cd-4cbc-89ef-2c8b1ccd66ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:45.220065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38ee9d-b4bb-4bda-8d4e-a1d2badb3b73 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:45.254624 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a4119708-33cd-4cbc-89ef-2c8b1ccd66ce None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:45.256497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a4119708-33cd-4cbc-89ef-2c8b1ccd66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:45.327392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afb529-94e1-4c6c-a01a-d09e348c1872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:45.328031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afb529-94e1-4c6c-a01a-d09e348c1872 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:45.328316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afb529-94e1-4c6c-a01a-d09e348c1872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:45.328592 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afb529-94e1-4c6c-a01a-d09e348c1872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:45.329252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afb529-94e1-4c6c-a01a-d09e348c1872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:45.342233 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afb529-94e1-4c6c-a01a-d09e348c1872 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:45.373277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1289/2605] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:45.384224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afb529-94e1-4c6c-a01a-d09e348c1872 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:45.393099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:45.410512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1317/2606] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:45.417755 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afb529-94e1-4c6c-a01a-d09e348c1872 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:45.420160 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4119708-33cd-4cbc-89ef-2c8b1ccd66ce None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:45.421905 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a4119708-33cd-4cbc-89ef-2c8b1ccd66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:45.424730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2329b2-4d06-470b-9971-6c3612ec1a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:45.425653 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2329b2-4d06-470b-9971-6c3612ec1a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:45.426029 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2329b2-4d06-470b-9971-6c3612ec1a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:45.426531 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2329b2-4d06-470b-9971-6c3612ec1a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:45.427396 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2329b2-4d06-470b-9971-6c3612ec1a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:45.429186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2329b2-4d06-470b-9971-6c3612ec1a3c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:45.442944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1290/2607] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:45.448224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2329b2-4d06-470b-9971-6c3612ec1a3c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:45.459329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2329b2-4d06-470b-9971-6c3612ec1a3c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:45.465138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547a5e6-e459-4f6d-9c44-fc71fa085fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:45.465885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a5e6-e459-4f6d-9c44-fc71fa085fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:45.466264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a5e6-e459-4f6d-9c44-fc71fa085fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:45.466617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547a5e6-e459-4f6d-9c44-fc71fa085fc8 admin admin] PATH_INFO: `/v3/projects/2f93964b03d94709a1e0eb5f60b95019/users/d276959e4f894915bd8afea1462136e3/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:45.484593 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547a5e6-e459-4f6d-9c44-fc71fa085fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f93964b03d94709a1e0eb5f60b95019, user_id=d276959e4f894915bd8afea1462136e3, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:45.487839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547a5e6-e459-4f6d-9c44-fc71fa085fc8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:45.496583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4119708-33cd-4cbc-89ef-2c8b1ccd66ce None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:45.500247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efcf42-9b67-43a1-825f-4d31cd9aa034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:45.500865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efcf42-9b67-43a1-825f-4d31cd9aa034 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:45.501151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efcf42-9b67-43a1-825f-4d31cd9aa034 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:45.501537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efcf42-9b67-43a1-825f-4d31cd9aa034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:45.511874 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efcf42-9b67-43a1-825f-4d31cd9aa034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:45.513591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efcf42-9b67-43a1-825f-4d31cd9aa034 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:45.524132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1318/2608] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:45.603448 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1291/2609] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:45 2022] PUT /identity/v3/projects/2f93964b03d94709a1e0eb5f60b95019/users/d276959e4f894915bd8afea1462136e3/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:45.621718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9b09e-4368-4bbc-af36-dbd52824442b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:45.622317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9b09e-4368-4bbc-af36-dbd52824442b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:45.622317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9b09e-4368-4bbc-af36-dbd52824442b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:45.790853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3ba9b09e-4368-4bbc-af36-dbd52824442b None None] MFA Rules not processed for user `d276959e4f894915bd8afea1462136e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:45.793505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3ba9b09e-4368-4bbc-af36-dbd52824442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:45.885418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1319/2610] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:45.887359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547a5e6-e459-4f6d-9c44-fc71fa085fc8 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:45.973583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547a5e6-e459-4f6d-9c44-fc71fa085fc8 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:45.980200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638e24c-87cc-402d-b5c5-7e4f295e08d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:45.980855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638e24c-87cc-402d-b5c5-7e4f295e08d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:45.981135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638e24c-87cc-402d-b5c5-7e4f295e08d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:45.981436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638e24c-87cc-402d-b5c5-7e4f295e08d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:45.982171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638e24c-87cc-402d-b5c5-7e4f295e08d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:45.984166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638e24c-87cc-402d-b5c5-7e4f295e08d6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:46.074499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9b09e-4368-4bbc-af36-dbd52824442b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:46.076043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3ba9b09e-4368-4bbc-af36-dbd52824442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:46.092924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9b09e-4368-4bbc-af36-dbd52824442b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:46.105058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:46.106186 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:46.106841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:46.107486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] PATH_INFO: `/v3/projects/025c2cee8ad44e7b9cf716dd9377d369` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:46.109219 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=025c2cee8ad44e7b9cf716dd9377d369)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:46.111634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:46.164011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1292/2611] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:45 2022] POST /identity/v3/projects => generated 387 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:46.165341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638e24c-87cc-402d-b5c5-7e4f295e08d6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:46.167743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9638e24c-87cc-402d-b5c5-7e4f295e08d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:46.237745 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638e24c-87cc-402d-b5c5-7e4f295e08d6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:46.243504 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00506e35-8cdd-4d30-9912-8ac7b1dd70bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:46.244161 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00506e35-8cdd-4d30-9912-8ac7b1dd70bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:46.244494 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00506e35-8cdd-4d30-9912-8ac7b1dd70bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:46.244795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00506e35-8cdd-4d30-9912-8ac7b1dd70bf admin admin] PATH_INFO: `/v3/users/df1998639e0649bab7d7c9caa7a6ec6c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:46.245959 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00506e35-8cdd-4d30-9912-8ac7b1dd70bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1998639e0649bab7d7c9caa7a6ec6c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:46.247973 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00506e35-8cdd-4d30-9912-8ac7b1dd70bf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:46.347255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025c2cee8ad44e7b9cf716dd9377d369', 'request_id': 'req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:46.462699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025c2cee8ad44e7b9cf716dd9377d369', 'request_id': 'req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:46.469369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025c2cee8ad44e7b9cf716dd9377d369', 'request_id': 'req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:46.481390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] The token cache is being invalidate because project 025c2cee8ad44e7b9cf716dd9377d369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:46.481706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:46.485279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:46.485279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1320/2612] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:46 2022] DELETE /identity/v3/projects/025c2cee8ad44e7b9cf716dd9377d369 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:46.485279 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:46.485830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:46.555013 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f0312-94dd-4305-b8ed-2cbf5b2fbdbc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:46.560432 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748c26-4447-449e-90f5-90e5229addd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:46.561076 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748c26-4447-449e-90f5-90e5229addd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:46.561362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748c26-4447-449e-90f5-90e5229addd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:46.561642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748c26-4447-449e-90f5-90e5229addd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:46.562293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55748c26-4447-449e-90f5-90e5229addd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:46.564362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55748c26-4447-449e-90f5-90e5229addd9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:46.633311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-00506e35-8cdd-4d30-9912-8ac7b1dd70bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1998639e0649bab7d7c9caa7a6ec6c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:46.761232 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1321/2613] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:46 2022] POST /identity/v3/users => generated 300 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:46.765031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748c26-4447-449e-90f5-90e5229addd9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:46.774735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748c26-4447-449e-90f5-90e5229addd9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:46.779899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3acb-3cee-43af-a391-048465b25725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:46.780476 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3acb-3cee-43af-a391-048465b25725 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:46.780760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3acb-3cee-43af-a391-048465b25725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:46.781037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b3acb-3cee-43af-a391-048465b25725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:46.781679 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b3acb-3cee-43af-a391-048465b25725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:46.783305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b3acb-3cee-43af-a391-048465b25725 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:46.793513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1322/2614] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:46.797527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3acb-3cee-43af-a391-048465b25725 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:46.807365 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b3acb-3cee-43af-a391-048465b25725 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:46.811951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76931eda-2668-4c6f-b726-21c4db54afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:46.812575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931eda-2668-4c6f-b726-21c4db54afbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:46.812854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931eda-2668-4c6f-b726-21c4db54afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:46.813127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931eda-2668-4c6f-b726-21c4db54afbc admin admin] PATH_INFO: `/v3/projects/6a8477829d08413e86075a86e53ec250/users/c73aafe4b4e14fc28b245d7d802b5464/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:46.827832 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76931eda-2668-4c6f-b726-21c4db54afbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8477829d08413e86075a86e53ec250, user_id=c73aafe4b4e14fc28b245d7d802b5464, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:46.830710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76931eda-2668-4c6f-b726-21c4db54afbc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:46.847685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-00506e35-8cdd-4d30-9912-8ac7b1dd70bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1998639e0649bab7d7c9caa7a6ec6c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:46.860900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-00506e35-8cdd-4d30-9912-8ac7b1dd70bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1998639e0649bab7d7c9caa7a6ec6c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:46.860900 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-00506e35-8cdd-4d30-9912-8ac7b1dd70bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1998639e0649bab7d7c9caa7a6ec6c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:46.877670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-00506e35-8cdd-4d30-9912-8ac7b1dd70bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1998639e0649bab7d7c9caa7a6ec6c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:46.884452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1293/2615] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:46 2022] DELETE /identity/v3/users/df1998639e0649bab7d7c9caa7a6ec6c => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:46.889720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520900aa-e52e-4344-acd3-718b897c179d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:46.890214 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520900aa-e52e-4344-acd3-718b897c179d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:46.895020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520900aa-e52e-4344-acd3-718b897c179d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:46.915724 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-520900aa-e52e-4344-acd3-718b897c179d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:46.917659 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-520900aa-e52e-4344-acd3-718b897c179d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:46.949288 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1323/2616] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:46 2022] PUT /identity/v3/projects/6a8477829d08413e86075a86e53ec250/users/c73aafe4b4e14fc28b245d7d802b5464/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:46.953274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76931eda-2668-4c6f-b726-21c4db54afbc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:46.954882 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-76931eda-2668-4c6f-b726-21c4db54afbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:46.981578 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1294/2617] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:46.991822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520900aa-e52e-4344-acd3-718b897c179d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:46.993223 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-520900aa-e52e-4344-acd3-718b897c179d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:47.020791 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76931eda-2668-4c6f-b726-21c4db54afbc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:47.025849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa248d51-3b8d-4c88-ba89-68869cba9621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:47.026683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248d51-3b8d-4c88-ba89-68869cba9621 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:47.027035 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248d51-3b8d-4c88-ba89-68869cba9621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:47.027375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa248d51-3b8d-4c88-ba89-68869cba9621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:47.028019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa248d51-3b8d-4c88-ba89-68869cba9621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:47.029654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa248d51-3b8d-4c88-ba89-68869cba9621 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:47.039797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1324/2618] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:47.044728 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa248d51-3b8d-4c88-ba89-68869cba9621 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:47.053203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520900aa-e52e-4344-acd3-718b897c179d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:47.054842 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa248d51-3b8d-4c88-ba89-68869cba9621 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:47.060284 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91147bff-d273-4633-85ed-2ac805492793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:47.061034 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91147bff-d273-4633-85ed-2ac805492793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:47.061273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91147bff-d273-4633-85ed-2ac805492793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:47.061549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91147bff-d273-4633-85ed-2ac805492793 admin admin] PATH_INFO: `/v3/projects/6a8477829d08413e86075a86e53ec250/users/c73aafe4b4e14fc28b245d7d802b5464/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:47.063603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91147bff-d273-4633-85ed-2ac805492793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8477829d08413e86075a86e53ec250, user_id=c73aafe4b4e14fc28b245d7d802b5464, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:47.066313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91147bff-d273-4633-85ed-2ac805492793 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:47.077914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1325/2619] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:47 2022] PUT /identity/v3/projects/6a8477829d08413e86075a86e53ec250/users/c73aafe4b4e14fc28b245d7d802b5464/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:47.088457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdcfcf-b038-4b46-9103-dc4d947a74a2 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:47.088748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdcfcf-b038-4b46-9103-dc4d947a74a2 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:47.089032 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdcfcf-b038-4b46-9103-dc4d947a74a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:47.106465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d2377-022f-4a1f-98bb-465b8acb681e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:47.107110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d2377-022f-4a1f-98bb-465b8acb681e service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:47.107397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d2377-022f-4a1f-98bb-465b8acb681e service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:47.107671 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d2377-022f-4a1f-98bb-465b8acb681e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:47.117492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d2377-022f-4a1f-98bb-465b8acb681e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:47.118213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-73bdcfcf-b038-4b46-9103-dc4d947a74a2 None None] MFA Rules not processed for user `c73aafe4b4e14fc28b245d7d802b5464`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:47.119170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d2377-022f-4a1f-98bb-465b8acb681e service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:47.120099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-73bdcfcf-b038-4b46-9103-dc4d947a74a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:47.130245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1295/2620] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:47.208533 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1326/2621] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:47.223538 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d2377-022f-4a1f-98bb-465b8acb681e service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:47.226796 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5e0d2377-022f-4a1f-98bb-465b8acb681e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:47.287129 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d2377-022f-4a1f-98bb-465b8acb681e service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:47.337283 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dc818-fcad-4b61-992c-8e2748719e20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:47.337891 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc818-fcad-4b61-992c-8e2748719e20 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:47.338190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc818-fcad-4b61-992c-8e2748719e20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:47.338465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc818-fcad-4b61-992c-8e2748719e20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:47.351994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dc818-fcad-4b61-992c-8e2748719e20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:47.353437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dc818-fcad-4b61-992c-8e2748719e20 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:47.363951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1296/2622] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:47.393011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdcfcf-b038-4b46-9103-dc4d947a74a2 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:47.488301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdcfcf-b038-4b46-9103-dc4d947a74a2 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:47.495285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bfb54-06f0-4deb-9302-1a327077ad0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:47.496007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bfb54-06f0-4deb-9302-1a327077ad0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:47.496296 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bfb54-06f0-4deb-9302-1a327077ad0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:47.496578 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bfb54-06f0-4deb-9302-1a327077ad0f admin admin] PATH_INFO: `/v3/users/d276959e4f894915bd8afea1462136e3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:47.497813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bfb54-06f0-4deb-9302-1a327077ad0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d276959e4f894915bd8afea1462136e3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:47.499950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bfb54-06f0-4deb-9302-1a327077ad0f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:47.669317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:47.727583 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dc818-fcad-4b61-992c-8e2748719e20 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:47.730486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4c3dc818-fcad-4b61-992c-8e2748719e20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:47.747189 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dc818-fcad-4b61-992c-8e2748719e20 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:47.762414 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:47.763293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:47.763553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:47.763847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] PATH_INFO: `/v3/projects/73510102f35a474ca0f67d332d300471` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:47.766486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=73510102f35a474ca0f67d332d300471)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:47.768525 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:47.790623 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cd2bfb54-06f0-4deb-9302-1a327077ad0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd276959e4f894915bd8afea1462136e3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:47.792156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cd2bfb54-06f0-4deb-9302-1a327077ad0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd276959e4f894915bd8afea1462136e3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:47.793752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cd2bfb54-06f0-4deb-9302-1a327077ad0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd276959e4f894915bd8afea1462136e3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:47.891713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cd2bfb54-06f0-4deb-9302-1a327077ad0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd276959e4f894915bd8afea1462136e3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:47.906117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cd2bfb54-06f0-4deb-9302-1a327077ad0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd276959e4f894915bd8afea1462136e3'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:47.921928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1327/2623] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:47 2022] DELETE /identity/v3/users/d276959e4f894915bd8afea1462136e3 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:47.926364 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b2b4-6f30-4354-a360-a3e4c98ba95e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:47.926771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b2b4-6f30-4354-a360-a3e4c98ba95e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:47.926982 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341b2b4-6f30-4354-a360-a3e4c98ba95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:47.928855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73510102f35a474ca0f67d332d300471', 'request_id': 'req-5f7535f4-4df6-472d-b3fe-32a188f48cbf'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:47.934686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73510102f35a474ca0f67d332d300471', 'request_id': 'req-5f7535f4-4df6-472d-b3fe-32a188f48cbf'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:47.947469 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3341b2b4-6f30-4354-a360-a3e4c98ba95e None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:47.949320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3341b2b4-6f30-4354-a360-a3e4c98ba95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:47.986060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:48.016531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1328/2624] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:48.033661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341b2b4-6f30-4354-a360-a3e4c98ba95e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:48.035498 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3341b2b4-6f30-4354-a360-a3e4c98ba95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:48.080403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73510102f35a474ca0f67d332d300471', 'request_id': 'req-5f7535f4-4df6-472d-b3fe-32a188f48cbf'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:48.092933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] The token cache is being invalidate because project 73510102f35a474ca0f67d332d300471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:48.093562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:48.094167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:48.096595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1297/2625] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:47 2022] DELETE /identity/v3/projects/73510102f35a474ca0f67d332d300471 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:48.103602 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:48.106929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341b2b4-6f30-4354-a360-a3e4c98ba95e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:48.108938 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:48.111080 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e6f9e-f6cd-481c-9c69-a8e6c02dc8cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:48.111675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e6f9e-f6cd-481c-9c69-a8e6c02dc8cd service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:48.111962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e6f9e-f6cd-481c-9c69-a8e6c02dc8cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:48.112240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e6f9e-f6cd-481c-9c69-a8e6c02dc8cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:48.114036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-076e6f9e-f6cd-481c-9c69-a8e6c02dc8cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:48.127695 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e6f9e-f6cd-481c-9c69-a8e6c02dc8cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:48.129066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e6f9e-f6cd-481c-9c69-a8e6c02dc8cd service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:48.139239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1329/2626] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:48.188407 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7535f4-4df6-472d-b3fe-32a188f48cbf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:48.193403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:48.193929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:48.194212 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:48.194485 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] PATH_INFO: `/v3/users/b9c477d355134179949a3d17a68b74df` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:48.195636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c477d355134179949a3d17a68b74df)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:48.197579 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:48.431753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c477d355134179949a3d17a68b74df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:48.582541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c477d355134179949a3d17a68b74df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:48.590690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c477d355134179949a3d17a68b74df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:48.591374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c477d355134179949a3d17a68b74df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:48.604400 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c477d355134179949a3d17a68b74df'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:48.610514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1298/2627] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:48 2022] DELETE /identity/v3/users/b9c477d355134179949a3d17a68b74df => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:48.706128 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e6f9e-f6cd-481c-9c69-a8e6c02dc8cd service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:48.707728 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-076e6f9e-f6cd-481c-9c69-a8e6c02dc8cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:48.720568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e6f9e-f6cd-481c-9c69-a8e6c02dc8cd service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:48.735648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:48.778700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:48.779372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:48.779657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:48.780028 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] PATH_INFO: `/v3/users/1b467ad495c5450484c77ca6aec58068` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:48.781059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b467ad495c5450484c77ca6aec58068)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:48.783097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:48.878356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:48.879925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:48.896120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df757f9-0c20-4924-b7be-4b38f97bc933 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:48.902547 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:48.903369 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:48.903698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:48.904044 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] PATH_INFO: `/v3/projects/2f93964b03d94709a1e0eb5f60b95019` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:48.905503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f93964b03d94709a1e0eb5f60b95019)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:48.907618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:49.023867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b467ad495c5450484c77ca6aec58068'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.024536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b467ad495c5450484c77ca6aec58068'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.025153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b467ad495c5450484c77ca6aec58068'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.057091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f93964b03d94709a1e0eb5f60b95019', 'request_id': 'req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.063307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f93964b03d94709a1e0eb5f60b95019', 'request_id': 'req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.120547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b467ad495c5450484c77ca6aec58068'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.133712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b467ad495c5450484c77ca6aec58068'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.147335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1330/2628] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:48 2022] DELETE /identity/v3/users/1b467ad495c5450484c77ca6aec58068 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:49.177553 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f93964b03d94709a1e0eb5f60b95019', 'request_id': 'req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.191763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] The token cache is being invalidate because project 2f93964b03d94709a1e0eb5f60b95019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:49.192309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.193312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.195082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1299/2629] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:48 2022] DELETE /identity/v3/projects/2f93964b03d94709a1e0eb5f60b95019 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:49.199709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:49.201181 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:49.273429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d68de1-371d-49bc-8a0d-d575621c3ec1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:49.278480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:49.279310 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:49.279599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:49.279880 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] PATH_INFO: `/v3/users/c73aafe4b4e14fc28b245d7d802b5464` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:49.281042 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73aafe4b4e14fc28b245d7d802b5464)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:49.283008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:49.308177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:49.309744 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:49.386053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb438c6-f8e2-4b5e-8c22-b31cba5caa8b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:49.390721 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:49.391408 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:49.391687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:49.391959 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] PATH_INFO: `/v3/projects/6e5f1ee0f6bd4e1585b83c9ca3919627` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:49.393082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5f1ee0f6bd4e1585b83c9ca3919627)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:49.395244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:49.539450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73aafe4b4e14fc28b245d7d802b5464'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.539711 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5f1ee0f6bd4e1585b83c9ca3919627', 'request_id': 'req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.540155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73aafe4b4e14fc28b245d7d802b5464'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.540741 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73aafe4b4e14fc28b245d7d802b5464'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.546469 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5f1ee0f6bd4e1585b83c9ca3919627', 'request_id': 'req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.626923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73aafe4b4e14fc28b245d7d802b5464'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.639584 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73aafe4b4e14fc28b245d7d802b5464'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.652051 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1331/2630] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:49 2022] DELETE /identity/v3/users/c73aafe4b4e14fc28b245d7d802b5464 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:49.652835 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:49.654157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:49.714963 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5f1ee0f6bd4e1585b83c9ca3919627', 'request_id': 'req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.725628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6e82-5d8d-4660-a88f-8dc5696307dc admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:49.732092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:49.732435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:49.732719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:49.733032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] The token cache is being invalidate because project 6e5f1ee0f6bd4e1585b83c9ca3919627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:49.733172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] PATH_INFO: `/v3/projects/701a775ffb80483da86e0dfdfbfbbc27` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:49.733521 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.734301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] RBAC: Authorizing `identity:delete_project(project_id=701a775ffb80483da86e0dfdfbfbbc27)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:49.734905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ebfe1bb8-a9ff-4e28-8240-cc701f53d114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.738924 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:49.739135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1300/2631] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:49 2022] DELETE /identity/v3/projects/6e5f1ee0f6bd4e1585b83c9ca3919627 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:49.745595 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5d457-d405-4f7a-a753-ea839c41ebaa None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:49.746018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5d457-d405-4f7a-a753-ea839c41ebaa None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:49.746498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5d457-d405-4f7a-a753-ea839c41ebaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:49.752222 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:49.782966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-42d5d457-d405-4f7a-a753-ea839c41ebaa None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:49.784145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-42d5d457-d405-4f7a-a753-ea839c41ebaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:49.794336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1301/2632] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:49.805347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3bfd-76c5-4ba5-adcc-7f8ae3f133fc None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:49.805347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3bfd-76c5-4ba5-adcc-7f8ae3f133fc None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:49.805347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3bfd-76c5-4ba5-adcc-7f8ae3f133fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:49.826114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f04a3bfd-76c5-4ba5-adcc-7f8ae3f133fc None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:49.828800 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f04a3bfd-76c5-4ba5-adcc-7f8ae3f133fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:49.844658 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1302/2633] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:49.848865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a3bfd-76c5-4ba5-adcc-7f8ae3f133fc None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:49.858549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a3bfd-76c5-4ba5-adcc-7f8ae3f133fc None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:49.863585 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d1c3b-de35-42fa-bf1d-c9cf35c490e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:49.864196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d1c3b-de35-42fa-bf1d-c9cf35c490e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:49.864473 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d1c3b-de35-42fa-bf1d-c9cf35c490e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:49.864743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d1c3b-de35-42fa-bf1d-c9cf35c490e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:49.865409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d1c3b-de35-42fa-bf1d-c9cf35c490e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:49.865702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d1c3b-de35-42fa-bf1d-c9cf35c490e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:49.867885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d1c3b-de35-42fa-bf1d-c9cf35c490e1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:49.883067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1303/2634] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:55:49.885562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d1c3b-de35-42fa-bf1d-c9cf35c490e1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:49.902391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d1c3b-de35-42fa-bf1d-c9cf35c490e1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:49.909066 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701a775ffb80483da86e0dfdfbfbbc27', 'request_id': 'req-a89621d4-6a75-4688-b8db-47dec4c4139c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:49.962380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf355a-0a94-4077-8f61-f550e4123ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:49.963522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf355a-0a94-4077-8f61-f550e4123ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:49.963806 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf355a-0a94-4077-8f61-f550e4123ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:49.964116 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf355a-0a94-4077-8f61-f550e4123ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:49.964748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf355a-0a94-4077-8f61-f550e4123ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:49.966674 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf355a-0a94-4077-8f61-f550e4123ed0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:50.017377 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701a775ffb80483da86e0dfdfbfbbc27', 'request_id': 'req-a89621d4-6a75-4688-b8db-47dec4c4139c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:50.028004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701a775ffb80483da86e0dfdfbfbbc27', 'request_id': 'req-a89621d4-6a75-4688-b8db-47dec4c4139c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:50.042383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] The token cache is being invalidate because project 701a775ffb80483da86e0dfdfbfbbc27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:50.042757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:50.043645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:50.045768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1332/2635] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:49 2022] DELETE /identity/v3/projects/701a775ffb80483da86e0dfdfbfbbc27 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:50.119802 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1304/2636] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:49 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:50.120977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:50.122477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:50.136217 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89621d4-6a75-4688-b8db-47dec4c4139c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:50.153119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf355a-0a94-4077-8f61-f550e4123ed0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:50.153427 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-cbaf355a-0a94-4077-8f61-f550e4123ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:50.211363 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd779aa-e2c5-41df-98a3-8be82046fab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:50.212326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd779aa-e2c5-41df-98a3-8be82046fab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.212814 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd779aa-e2c5-41df-98a3-8be82046fab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.213632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd779aa-e2c5-41df-98a3-8be82046fab1 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.214305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd779aa-e2c5-41df-98a3-8be82046fab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:50.216460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd779aa-e2c5-41df-98a3-8be82046fab1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:50.245313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf355a-0a94-4077-8f61-f550e4123ed0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:50.252004 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:50.252856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.253154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.253423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] PATH_INFO: `/v3/projects/6a8477829d08413e86075a86e53ec250` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.255534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8477829d08413e86075a86e53ec250)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:50.262190 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:50.308877 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1333/2637] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:50 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:50.312841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd779aa-e2c5-41df-98a3-8be82046fab1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:50.323125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd779aa-e2c5-41df-98a3-8be82046fab1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:50.328274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ec5a-c68a-4530-93c6-d46f748a0d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:50.328856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ec5a-c68a-4530-93c6-d46f748a0d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.329167 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ec5a-c68a-4530-93c6-d46f748a0d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.329440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ec5a-c68a-4530-93c6-d46f748a0d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.330077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815ec5a-c68a-4530-93c6-d46f748a0d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:50.331738 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815ec5a-c68a-4530-93c6-d46f748a0d07 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:50.342672 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1334/2638] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:50.348815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ec5a-c68a-4530-93c6-d46f748a0d07 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:50.358553 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ec5a-c68a-4530-93c6-d46f748a0d07 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:50.363291 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd7a56-dc8e-45b6-8faa-05a75ad7d678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:50.363873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd7a56-dc8e-45b6-8faa-05a75ad7d678 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.364155 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd7a56-dc8e-45b6-8faa-05a75ad7d678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.364429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd7a56-dc8e-45b6-8faa-05a75ad7d678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.365065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd7a56-dc8e-45b6-8faa-05a75ad7d678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:50.366669 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd7a56-dc8e-45b6-8faa-05a75ad7d678 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:50.377852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1335/2639] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:50.381458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd7a56-dc8e-45b6-8faa-05a75ad7d678 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:50.391564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd7a56-dc8e-45b6-8faa-05a75ad7d678 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:50.396185 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b063ec-1ed3-4254-a3c3-7d0bd930afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:50.396856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b063ec-1ed3-4254-a3c3-7d0bd930afd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.397139 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b063ec-1ed3-4254-a3c3-7d0bd930afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.397413 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b063ec-1ed3-4254-a3c3-7d0bd930afd3 admin admin] PATH_INFO: `/v3/projects/fb8d824d1e1749efbd646e4b499e19a2/users/243f0362d6c443b3a6a231a8b489b75c/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.417593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b063ec-1ed3-4254-a3c3-7d0bd930afd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8d824d1e1749efbd646e4b499e19a2, user_id=243f0362d6c443b3a6a231a8b489b75c, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:50.420320 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b063ec-1ed3-4254-a3c3-7d0bd930afd3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:50.425176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8477829d08413e86075a86e53ec250', 'request_id': 'req-8f794591-af3f-4058-85e5-f3d9d4f26b0d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:50.429333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:50.430084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8477829d08413e86075a86e53ec250', 'request_id': 'req-8f794591-af3f-4058-85e5-f3d9d4f26b0d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:50.489567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1336/2640] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:50 2022] PUT /identity/v3/projects/fb8d824d1e1749efbd646e4b499e19a2/users/243f0362d6c443b3a6a231a8b489b75c/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:50.501967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f9612-fafe-433e-8c8e-3697d488c0b5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.502343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f9612-fafe-433e-8c8e-3697d488c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.502621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f9612-fafe-433e-8c8e-3697d488c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.512598 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8477829d08413e86075a86e53ec250', 'request_id': 'req-8f794591-af3f-4058-85e5-f3d9d4f26b0d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:50.525179 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] The token cache is being invalidate because project 6a8477829d08413e86075a86e53ec250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:50.525720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:50.526452 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8f794591-af3f-4058-85e5-f3d9d4f26b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:50.528339 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1305/2641] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:50 2022] DELETE /identity/v3/projects/6a8477829d08413e86075a86e53ec250 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:50.531635 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a81f9612-fafe-433e-8c8e-3697d488c0b5 None None] MFA Rules not processed for user `243f0362d6c443b3a6a231a8b489b75c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:50.532854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a81f9612-fafe-433e-8c8e-3697d488c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:50.532998 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb580a1-7a65-488e-a709-34edf0cd39bc None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.533138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb580a1-7a65-488e-a709-34edf0cd39bc None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.533418 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb580a1-7a65-488e-a709-34edf0cd39bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.553770 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-3cb580a1-7a65-488e-a709-34edf0cd39bc None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:50.555018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3cb580a1-7a65-488e-a709-34edf0cd39bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:50.597422 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1337/2642] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:50.609358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f9612-fafe-433e-8c8e-3697d488c0b5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:50.610853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a81f9612-fafe-433e-8c8e-3697d488c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:50.617390 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1306/2643] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:50.626668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7748c71-c4ed-48a6-ac7a-194172b10859 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.626964 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7748c71-c4ed-48a6-ac7a-194172b10859 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.627258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7748c71-c4ed-48a6-ac7a-194172b10859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.647066 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d7748c71-c4ed-48a6-ac7a-194172b10859 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:50.648461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d7748c71-c4ed-48a6-ac7a-194172b10859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:50.657672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1307/2644] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:50.662028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7748c71-c4ed-48a6-ac7a-194172b10859 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:50.668051 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f9612-fafe-433e-8c8e-3697d488c0b5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:50.671607 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7748c71-c4ed-48a6-ac7a-194172b10859 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:50.671735 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f8160-6162-40ca-bfb3-2ce25e6231cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:50.672347 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8160-6162-40ca-bfb3-2ce25e6231cf service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.672870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8160-6162-40ca-bfb3-2ce25e6231cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.675409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8160-6162-40ca-bfb3-2ce25e6231cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.675973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:50.676874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb97f63-0d88-4600-ba0c-1943b1fbf883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:50.677499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb97f63-0d88-4600-ba0c-1943b1fbf883 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.677782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb97f63-0d88-4600-ba0c-1943b1fbf883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.678089 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb97f63-0d88-4600-ba0c-1943b1fbf883 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.678776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb97f63-0d88-4600-ba0c-1943b1fbf883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:50.679122 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb97f63-0d88-4600-ba0c-1943b1fbf883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:50.680767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb97f63-0d88-4600-ba0c-1943b1fbf883 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:50.684636 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f8160-6162-40ca-bfb3-2ce25e6231cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:50.686080 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f8160-6162-40ca-bfb3-2ce25e6231cf service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:50.693131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1308/2645] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:55:50.695585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1338/2646] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:50.701615 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb97f63-0d88-4600-ba0c-1943b1fbf883 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:50.716966 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb97f63-0d88-4600-ba0c-1943b1fbf883 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:50.717706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f8160-6162-40ca-bfb3-2ce25e6231cf service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:50.719211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4e5f8160-6162-40ca-bfb3-2ce25e6231cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:50.722123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77b567-2932-46d9-98e3-737b4caa249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:50.722731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b567-2932-46d9-98e3-737b4caa249f admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.723015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b567-2932-46d9-98e3-737b4caa249f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.723324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b567-2932-46d9-98e3-737b4caa249f admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.724057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77b567-2932-46d9-98e3-737b4caa249f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:50.726034 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77b567-2932-46d9-98e3-737b4caa249f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:50.733226 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f8160-6162-40ca-bfb3-2ce25e6231cf service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:50.737998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2d21c-e62c-4853-8313-0ea0beadc510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:50.738627 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d21c-e62c-4853-8313-0ea0beadc510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.738908 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d21c-e62c-4853-8313-0ea0beadc510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.739215 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2d21c-e62c-4853-8313-0ea0beadc510 admin admin] PATH_INFO: `/v3/users/243f0362d6c443b3a6a231a8b489b75c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.740427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2d21c-e62c-4853-8313-0ea0beadc510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=243f0362d6c443b3a6a231a8b489b75c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:50.742289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2d21c-e62c-4853-8313-0ea0beadc510 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:50.842482 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1309/2647] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:50 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:50.846843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77b567-2932-46d9-98e3-737b4caa249f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:50.909961 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77b567-2932-46d9-98e3-737b4caa249f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:50.914815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96023ac-ebd3-4b72-8ac3-01b250c4b362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:50.915476 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96023ac-ebd3-4b72-8ac3-01b250c4b362 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:50.915762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96023ac-ebd3-4b72-8ac3-01b250c4b362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:50.916060 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96023ac-ebd3-4b72-8ac3-01b250c4b362 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:50.916680 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96023ac-ebd3-4b72-8ac3-01b250c4b362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:50.918695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96023ac-ebd3-4b72-8ac3-01b250c4b362 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:50.996453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7bc2d21c-e62c-4853-8313-0ea0beadc510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '243f0362d6c443b3a6a231a8b489b75c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:50.997036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7bc2d21c-e62c-4853-8313-0ea0beadc510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '243f0362d6c443b3a6a231a8b489b75c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:50.997654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7bc2d21c-e62c-4853-8313-0ea0beadc510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '243f0362d6c443b3a6a231a8b489b75c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:51.046166 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1310/2648] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:50 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:51.050921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96023ac-ebd3-4b72-8ac3-01b250c4b362 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:51.052668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c96023ac-ebd3-4b72-8ac3-01b250c4b362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:51.065013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96023ac-ebd3-4b72-8ac3-01b250c4b362 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:51.069675 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1a4e9-3f95-41fc-aece-2355013d8a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:51.070262 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1a4e9-3f95-41fc-aece-2355013d8a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:51.070581 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1a4e9-3f95-41fc-aece-2355013d8a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:51.070854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1a4e9-3f95-41fc-aece-2355013d8a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:51.071528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1a4e9-3f95-41fc-aece-2355013d8a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:51.073376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1a4e9-3f95-41fc-aece-2355013d8a22 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:51.074234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7bc2d21c-e62c-4853-8313-0ea0beadc510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '243f0362d6c443b3a6a231a8b489b75c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:51.084313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1311/2649] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:51.088440 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1a4e9-3f95-41fc-aece-2355013d8a22 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:51.090798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7bc2d21c-e62c-4853-8313-0ea0beadc510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '243f0362d6c443b3a6a231a8b489b75c'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:51.098258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1a4e9-3f95-41fc-aece-2355013d8a22 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:51.106019 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1339/2650] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:50 2022] DELETE /identity/v3/users/243f0362d6c443b3a6a231a8b489b75c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:51.106423 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1de658-a537-43aa-8a08-1fcc5d205d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:51.107613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1de658-a537-43aa-8a08-1fcc5d205d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:51.108082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1de658-a537-43aa-8a08-1fcc5d205d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:51.108461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1de658-a537-43aa-8a08-1fcc5d205d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:51.109317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1de658-a537-43aa-8a08-1fcc5d205d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:51.110582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e3050-2820-4206-bf54-22775d5a5ae0 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:51.111039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1de658-a537-43aa-8a08-1fcc5d205d1d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:51.111488 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e3050-2820-4206-bf54-22775d5a5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:51.111976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e3050-2820-4206-bf54-22775d5a5ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:51.115526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:51.126279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1312/2651] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:51.130347 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1de658-a537-43aa-8a08-1fcc5d205d1d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:51.139698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-920e3050-2820-4206-bf54-22775d5a5ae0 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:51.139698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-920e3050-2820-4206-bf54-22775d5a5ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:51.143478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1de658-a537-43aa-8a08-1fcc5d205d1d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:51.206113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1340/2652] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:51.207954 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e3050-2820-4206-bf54-22775d5a5ae0 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:51.208353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97a34e-e95f-456f-8516-e9ccbb2ea426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:51.209032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97a34e-e95f-456f-8516-e9ccbb2ea426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:51.209310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97a34e-e95f-456f-8516-e9ccbb2ea426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:51.209584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97a34e-e95f-456f-8516-e9ccbb2ea426 admin admin] PATH_INFO: `/v3/projects/fea9f25a525b440f8ac824ff014f6c94/users/d128f2a96ce94eca9eb8ba8bb0b854a0/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:51.210267 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-920e3050-2820-4206-bf54-22775d5a5ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:51.225485 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97a34e-e95f-456f-8516-e9ccbb2ea426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea9f25a525b440f8ac824ff014f6c94, user_id=d128f2a96ce94eca9eb8ba8bb0b854a0, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:51.228309 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97a34e-e95f-456f-8516-e9ccbb2ea426 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:51.269489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e3050-2820-4206-bf54-22775d5a5ae0 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:51.273428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2df30-596b-4358-8a04-a07122cc64ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:51.274040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2df30-596b-4358-8a04-a07122cc64ed service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:51.274322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2df30-596b-4358-8a04-a07122cc64ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:51.274602 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2df30-596b-4358-8a04-a07122cc64ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:51.279817 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1fc2df30-596b-4358-8a04-a07122cc64ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:51.288473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2df30-596b-4358-8a04-a07122cc64ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:51.289995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2df30-596b-4358-8a04-a07122cc64ed service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:51.300839 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1341/2653] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:51.301668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2df30-596b-4358-8a04-a07122cc64ed service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:51.303021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1fc2df30-596b-4358-8a04-a07122cc64ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:51.316544 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2df30-596b-4358-8a04-a07122cc64ed service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:51.319399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1313/2654] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:51 2022] PUT /identity/v3/projects/fea9f25a525b440f8ac824ff014f6c94/users/d128f2a96ce94eca9eb8ba8bb0b854a0/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:51.320907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60b58-f487-4adf-bf05-ab1986943e45 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:51.321218 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60b58-f487-4adf-bf05-ab1986943e45 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:51.321495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60b58-f487-4adf-bf05-ab1986943e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:51.352518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bac60b58-f487-4adf-bf05-ab1986943e45 None None] MFA Rules not processed for user `d128f2a96ce94eca9eb8ba8bb0b854a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:51.354433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bac60b58-f487-4adf-bf05-ab1986943e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:51.375385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34413e94-1897-43f3-aa74-f5b7b9011e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:51.376010 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34413e94-1897-43f3-aa74-f5b7b9011e68 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:51.376298 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34413e94-1897-43f3-aa74-f5b7b9011e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:51.376702 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34413e94-1897-43f3-aa74-f5b7b9011e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:51.424992 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:51.429297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1314/2655] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:51.433648 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60b58-f487-4adf-bf05-ab1986943e45 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:51.458194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34413e94-1897-43f3-aa74-f5b7b9011e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:51.460448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34413e94-1897-43f3-aa74-f5b7b9011e68 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:51.471923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1342/2656] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:51.515820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60b58-f487-4adf-bf05-ab1986943e45 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:51.521248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1455191-1136-49b3-b1d4-fb5e5d4d366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:51.522089 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455191-1136-49b3-b1d4-fb5e5d4d366a admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:51.522541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455191-1136-49b3-b1d4-fb5e5d4d366a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:51.522814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455191-1136-49b3-b1d4-fb5e5d4d366a admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:51.523668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1455191-1136-49b3-b1d4-fb5e5d4d366a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:51.526141 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1455191-1136-49b3-b1d4-fb5e5d4d366a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:51.534202 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:51.662336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1315/2657] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:51 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:51.664265 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34413e94-1897-43f3-aa74-f5b7b9011e68 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:51.674593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34413e94-1897-43f3-aa74-f5b7b9011e68 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:51.753778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa905-50e2-4d6b-8733-f5dff1ccd73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:51.754395 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa905-50e2-4d6b-8733-f5dff1ccd73e admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:51.754674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa905-50e2-4d6b-8733-f5dff1ccd73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:51.754946 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa905-50e2-4d6b-8733-f5dff1ccd73e admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:51.755634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa905-50e2-4d6b-8733-f5dff1ccd73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:51.757676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa905-50e2-4d6b-8733-f5dff1ccd73e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:51.897878 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1343/2658] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:51 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:51.901694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1455191-1136-49b3-b1d4-fb5e5d4d366a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:51.911875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1455191-1136-49b3-b1d4-fb5e5d4d366a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:51.917215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71637e3c-a83e-4637-babf-22f5afa8e03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:51.917815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71637e3c-a83e-4637-babf-22f5afa8e03d admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:51.918092 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71637e3c-a83e-4637-babf-22f5afa8e03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:51.918360 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71637e3c-a83e-4637-babf-22f5afa8e03d admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:51.919009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71637e3c-a83e-4637-babf-22f5afa8e03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:51.920700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71637e3c-a83e-4637-babf-22f5afa8e03d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:51.931131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1316/2659] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:51.935975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa905-50e2-4d6b-8733-f5dff1ccd73e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:51.944022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:51.948508 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa905-50e2-4d6b-8733-f5dff1ccd73e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:51.953837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f2bb6-b9e4-4bff-b4fd-e520a6ac3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:51.954516 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f2bb6-b9e4-4bff-b4fd-e520a6ac3890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:51.954825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f2bb6-b9e4-4bff-b4fd-e520a6ac3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:51.955145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f2bb6-b9e4-4bff-b4fd-e520a6ac3890 admin admin] PATH_INFO: `/v3/projects/b86ceb3fc075474c8c8dbbcce750ccdb/users/8065e12aac7c4bf494402fc6c01525cc/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:51.970059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f2bb6-b9e4-4bff-b4fd-e520a6ac3890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86ceb3fc075474c8c8dbbcce750ccdb, user_id=8065e12aac7c4bf494402fc6c01525cc, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:51.972764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f2bb6-b9e4-4bff-b4fd-e520a6ac3890 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:51.985120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71637e3c-a83e-4637-babf-22f5afa8e03d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:51.986956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-71637e3c-a83e-4637-babf-22f5afa8e03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:52.001880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71637e3c-a83e-4637-babf-22f5afa8e03d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.006791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.009909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.009909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.009909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] PATH_INFO: `/v3/projects/fb8d824d1e1749efbd646e4b499e19a2` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.009909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8d824d1e1749efbd646e4b499e19a2)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.011167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:52.064157 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1344/2660] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:51 2022] PUT /identity/v3/projects/b86ceb3fc075474c8c8dbbcce750ccdb/users/8065e12aac7c4bf494402fc6c01525cc/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:52.068380 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f2bb6-b9e4-4bff-b4fd-e520a6ac3890 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.134541 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f2bb6-b9e4-4bff-b4fd-e520a6ac3890 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.140973 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8d824d1e1749efbd646e4b499e19a2', 'request_id': 'req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:52.148926 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8d824d1e1749efbd646e4b499e19a2', 'request_id': 'req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:52.192131 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c8cc2-827b-4c83-9609-9fb5ede5e95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.192747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c8cc2-827b-4c83-9609-9fb5ede5e95d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.193024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c8cc2-827b-4c83-9609-9fb5ede5e95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.193298 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c8cc2-827b-4c83-9609-9fb5ede5e95d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.193940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c8cc2-827b-4c83-9609-9fb5ede5e95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.195593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c8cc2-827b-4c83-9609-9fb5ede5e95d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:52.206621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1345/2661] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:52.213370 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c8cc2-827b-4c83-9609-9fb5ede5e95d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.229177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c8cc2-827b-4c83-9609-9fb5ede5e95d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.232523 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8d824d1e1749efbd646e4b499e19a2', 'request_id': 'req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:52.237239 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc00da-86cf-4d96-8106-aa7732fd8931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.238480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc00da-86cf-4d96-8106-aa7732fd8931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.239174 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc00da-86cf-4d96-8106-aa7732fd8931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.239604 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc00da-86cf-4d96-8106-aa7732fd8931 admin admin] PATH_INFO: `/v3/projects/b86ceb3fc075474c8c8dbbcce750ccdb/users/8065e12aac7c4bf494402fc6c01525cc/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.243696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc00da-86cf-4d96-8106-aa7732fd8931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86ceb3fc075474c8c8dbbcce750ccdb, user_id=8065e12aac7c4bf494402fc6c01525cc, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.247507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc00da-86cf-4d96-8106-aa7732fd8931 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:52.248039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] The token cache is being invalidate because project fb8d824d1e1749efbd646e4b499e19a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:52.248340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:52.253676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-ef15c49b-81ee-449f-9cf8-db5fe0d44b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:52.253676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1317/2662] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:51 2022] DELETE /identity/v3/projects/fb8d824d1e1749efbd646e4b499e19a2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:52.257422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add267aa-242f-47ea-a642-ce91eea16d29 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.257719 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add267aa-242f-47ea-a642-ce91eea16d29 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.258000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add267aa-242f-47ea-a642-ce91eea16d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.261317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1346/2663] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:52 2022] PUT /identity/v3/projects/b86ceb3fc075474c8c8dbbcce750ccdb/users/8065e12aac7c4bf494402fc6c01525cc/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:52.272596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e94702-d424-4db6-97d2-10a73b4de919 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.272890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e94702-d424-4db6-97d2-10a73b4de919 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.273172 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e94702-d424-4db6-97d2-10a73b4de919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.295836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-add267aa-242f-47ea-a642-ce91eea16d29 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:52.297095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-add267aa-242f-47ea-a642-ce91eea16d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:52.309568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:52.314134 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a8e94702-d424-4db6-97d2-10a73b4de919 None None] MFA Rules not processed for user `8065e12aac7c4bf494402fc6c01525cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:52.319316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a8e94702-d424-4db6-97d2-10a73b4de919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:52.372888 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1318/2664] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:52.383022 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526bfb-b554-4480-a820-1d32a72b6f71 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.383357 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526bfb-b554-4480-a820-1d32a72b6f71 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.383643 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526bfb-b554-4480-a820-1d32a72b6f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.406791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-5f526bfb-b554-4480-a820-1d32a72b6f71 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:52.408394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5f526bfb-b554-4480-a820-1d32a72b6f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:52.412270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1347/2665] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:52.423998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e94702-d424-4db6-97d2-10a73b4de919 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.425573 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a8e94702-d424-4db6-97d2-10a73b4de919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:52.426254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1319/2666] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:52.430120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f526bfb-b554-4480-a820-1d32a72b6f71 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.439986 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:52.445402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f526bfb-b554-4480-a820-1d32a72b6f71 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.451575 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edec81b-3a02-428d-9b31-220f52e2d6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.452764 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edec81b-3a02-428d-9b31-220f52e2d6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.453222 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edec81b-3a02-428d-9b31-220f52e2d6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.453725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edec81b-3a02-428d-9b31-220f52e2d6d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.454577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edec81b-3a02-428d-9b31-220f52e2d6d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:52.455073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edec81b-3a02-428d-9b31-220f52e2d6d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.456885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edec81b-3a02-428d-9b31-220f52e2d6d0 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:52.474752 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1320/2667] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:55:52.476912 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edec81b-3a02-428d-9b31-220f52e2d6d0 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.489243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edec81b-3a02-428d-9b31-220f52e2d6d0 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.500686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca9a9-1327-4472-8bf1-750c304fbb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.501661 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca9a9-1327-4472-8bf1-750c304fbb4f admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.502009 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca9a9-1327-4472-8bf1-750c304fbb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.502383 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca9a9-1327-4472-8bf1-750c304fbb4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.503195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ca9a9-1327-4472-8bf1-750c304fbb4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.506936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ca9a9-1327-4472-8bf1-750c304fbb4f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:52.510511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e94702-d424-4db6-97d2-10a73b4de919 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.516902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745c5a-d481-47bd-ab15-880fffd55896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.517637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745c5a-d481-47bd-ab15-880fffd55896 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.518191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745c5a-d481-47bd-ab15-880fffd55896 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.518813 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745c5a-d481-47bd-ab15-880fffd55896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.532992 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7745c5a-d481-47bd-ab15-880fffd55896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.534963 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7745c5a-d481-47bd-ab15-880fffd55896 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:52.546575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1348/2668] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:52.628484 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1321/2669] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:52 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:52.629953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745c5a-d481-47bd-ab15-880fffd55896 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.640459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745c5a-d481-47bd-ab15-880fffd55896 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.711430 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eacc89-25b2-4cd4-a743-0f251de54f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.712081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eacc89-25b2-4cd4-a743-0f251de54f61 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.712474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eacc89-25b2-4cd4-a743-0f251de54f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.712945 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eacc89-25b2-4cd4-a743-0f251de54f61 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.713586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eacc89-25b2-4cd4-a743-0f251de54f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.715561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eacc89-25b2-4cd4-a743-0f251de54f61 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:52.742114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:52.799089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1349/2670] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:52 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:52.801905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca9a9-1327-4472-8bf1-750c304fbb4f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.818717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca9a9-1327-4472-8bf1-750c304fbb4f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.826165 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d92143-2431-42a1-8b6c-fc7b74d94672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.826886 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d92143-2431-42a1-8b6c-fc7b74d94672 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.827154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d92143-2431-42a1-8b6c-fc7b74d94672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.827438 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d92143-2431-42a1-8b6c-fc7b74d94672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.828099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d92143-2431-42a1-8b6c-fc7b74d94672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.829713 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d92143-2431-42a1-8b6c-fc7b74d94672 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:52.850157 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1322/2671] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:52.854600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eacc89-25b2-4cd4-a743-0f251de54f61 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.875360 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eacc89-25b2-4cd4-a743-0f251de54f61 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.899961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243e2b4-4a3d-488d-8353-b706e662f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.901315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243e2b4-4a3d-488d-8353-b706e662f150 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.901772 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243e2b4-4a3d-488d-8353-b706e662f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.902052 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243e2b4-4a3d-488d-8353-b706e662f150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.902795 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243e2b4-4a3d-488d-8353-b706e662f150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.904499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243e2b4-4a3d-488d-8353-b706e662f150 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:52.918385 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1350/2672] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:52.922344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d92143-2431-42a1-8b6c-fc7b74d94672 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.935813 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d92143-2431-42a1-8b6c-fc7b74d94672 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.950385 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5756-81f8-4970-8e44-2c99f6eeb593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.951262 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5756-81f8-4970-8e44-2c99f6eeb593 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.951742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5756-81f8-4970-8e44-2c99f6eeb593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.952127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5756-81f8-4970-8e44-2c99f6eeb593 admin admin] PATH_INFO: `/v3/projects/b248f42dc69c4252937debf5434bd163/users/a1c1954116f148b5952d407d8a4c06a0/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.974193 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae5756-81f8-4970-8e44-2c99f6eeb593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b248f42dc69c4252937debf5434bd163, user_id=a1c1954116f148b5952d407d8a4c06a0, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.980121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae5756-81f8-4970-8e44-2c99f6eeb593 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:53.058196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1323/2673] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:52 2022] PUT /identity/v3/projects/b248f42dc69c4252937debf5434bd163/users/a1c1954116f148b5952d407d8a4c06a0/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:53.069229 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ea429-f0b5-4e03-810a-597d007b2675 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:53.070194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ea429-f0b5-4e03-810a-597d007b2675 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:53.070194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ea429-f0b5-4e03-810a-597d007b2675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:53.077358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:53.107202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-416ea429-f0b5-4e03-810a-597d007b2675 None None] MFA Rules not processed for user `a1c1954116f148b5952d407d8a4c06a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:53.108457 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-416ea429-f0b5-4e03-810a-597d007b2675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:53.157973 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5756-81f8-4970-8e44-2c99f6eeb593 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:53.159682 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-faae5756-81f8-4970-8e44-2c99f6eeb593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:53.178660 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1351/2674] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:53.183314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ea429-f0b5-4e03-810a-597d007b2675 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:53.250952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5756-81f8-4970-8e44-2c99f6eeb593 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:53.254940 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ea429-f0b5-4e03-810a-597d007b2675 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:53.257248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de11135-0a6e-43a2-bec7-6f5f8dc5f3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:53.258978 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de11135-0a6e-43a2-bec7-6f5f8dc5f3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:53.259430 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de11135-0a6e-43a2-bec7-6f5f8dc5f3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:53.260373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de11135-0a6e-43a2-bec7-6f5f8dc5f3d5 admin admin] PATH_INFO: `/v3/users/d128f2a96ce94eca9eb8ba8bb0b854a0` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:53.262018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de11135-0a6e-43a2-bec7-6f5f8dc5f3d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d128f2a96ce94eca9eb8ba8bb0b854a0)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:53.263223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8af23-d39b-495b-b98a-d92fa983f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:53.263892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8af23-d39b-495b-b98a-d92fa983f018 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:53.264177 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8af23-d39b-495b-b98a-d92fa983f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:53.264402 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de11135-0a6e-43a2-bec7-6f5f8dc5f3d5 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:53.264521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8af23-d39b-495b-b98a-d92fa983f018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:53.265076 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8af23-d39b-495b-b98a-d92fa983f018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:53.267628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8af23-d39b-495b-b98a-d92fa983f018 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:53.331906 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:53.384612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1352/2675] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:53 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:53.389844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8af23-d39b-495b-b98a-d92fa983f018 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:53.469825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8af23-d39b-495b-b98a-d92fa983f018 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:53.479026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f6ada-e708-418d-b9f4-98d467e88140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:53.480103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6ada-e708-418d-b9f4-98d467e88140 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:53.480484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6ada-e708-418d-b9f4-98d467e88140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:53.480860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f6ada-e708-418d-b9f4-98d467e88140 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:53.481205 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2de11135-0a6e-43a2-bec7-6f5f8dc5f3d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd128f2a96ce94eca9eb8ba8bb0b854a0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.481659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f6ada-e708-418d-b9f4-98d467e88140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:53.483850 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f6ada-e708-418d-b9f4-98d467e88140 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:53.554235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2de11135-0a6e-43a2-bec7-6f5f8dc5f3d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd128f2a96ce94eca9eb8ba8bb0b854a0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.561815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2de11135-0a6e-43a2-bec7-6f5f8dc5f3d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd128f2a96ce94eca9eb8ba8bb0b854a0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.562461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2de11135-0a6e-43a2-bec7-6f5f8dc5f3d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd128f2a96ce94eca9eb8ba8bb0b854a0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.576046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2de11135-0a6e-43a2-bec7-6f5f8dc5f3d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd128f2a96ce94eca9eb8ba8bb0b854a0'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.582858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1324/2676] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:53 2022] DELETE /identity/v3/users/d128f2a96ce94eca9eb8ba8bb0b854a0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:53.589049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b966dd-26bb-4345-888d-bf540790f401 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:53.589049 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b966dd-26bb-4345-888d-bf540790f401 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:53.589784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b966dd-26bb-4345-888d-bf540790f401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:53.593964 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1353/2677] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:53 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:53.598100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f6ada-e708-418d-b9f4-98d467e88140 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:53.604288 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-fe5f6ada-e708-418d-b9f4-98d467e88140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:53.609365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-18b966dd-26bb-4345-888d-bf540790f401 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:53.610552 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-18b966dd-26bb-4345-888d-bf540790f401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:53.617668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f6ada-e708-418d-b9f4-98d467e88140 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:53.671626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1325/2678] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:53.677761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa0503-ad2a-4690-9272-ef92a224b32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:53.678390 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0503-ad2a-4690-9272-ef92a224b32a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:53.678680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0503-ad2a-4690-9272-ef92a224b32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:53.679070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0503-ad2a-4690-9272-ef92a224b32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:53.679642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa0503-ad2a-4690-9272-ef92a224b32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:53.682138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa0503-ad2a-4690-9272-ef92a224b32a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:53.683874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b966dd-26bb-4345-888d-bf540790f401 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:53.684826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-18b966dd-26bb-4345-888d-bf540790f401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:53.702471 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1354/2679] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:53.704099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa0503-ad2a-4690-9272-ef92a224b32a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:53.715356 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa0503-ad2a-4690-9272-ef92a224b32a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:53.721800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f5c0c-ba3c-4ad6-b248-2ae858f98171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:53.722856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5c0c-ba3c-4ad6-b248-2ae858f98171 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:53.723314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5c0c-ba3c-4ad6-b248-2ae858f98171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:53.723596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5c0c-ba3c-4ad6-b248-2ae858f98171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:53.724247 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f5c0c-ba3c-4ad6-b248-2ae858f98171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:53.725864 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f5c0c-ba3c-4ad6-b248-2ae858f98171 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:53.737011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1355/2680] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:53.741339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f5c0c-ba3c-4ad6-b248-2ae858f98171 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:53.752751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f5c0c-ba3c-4ad6-b248-2ae858f98171 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:53.758433 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebad5e-f357-4228-9fe1-e51e078566ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:53.758700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b966dd-26bb-4345-888d-bf540790f401 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:53.759183 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebad5e-f357-4228-9fe1-e51e078566ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:53.759401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebad5e-f357-4228-9fe1-e51e078566ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:53.759748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebad5e-f357-4228-9fe1-e51e078566ef admin admin] PATH_INFO: `/v3/projects/b8cd24a2a6d14b81b8bbd5a1e97e1f91/users/2665899476e646fa96623f78d76f1c53/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:53.764206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041154fd-d269-400a-9fc2-76a85ea8bd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:53.764394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041154fd-d269-400a-9fc2-76a85ea8bd8f service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:53.764640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041154fd-d269-400a-9fc2-76a85ea8bd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:53.764918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041154fd-d269-400a-9fc2-76a85ea8bd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:53.774587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041154fd-d269-400a-9fc2-76a85ea8bd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:53.775881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebad5e-f357-4228-9fe1-e51e078566ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8cd24a2a6d14b81b8bbd5a1e97e1f91, user_id=2665899476e646fa96623f78d76f1c53, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:53.776119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041154fd-d269-400a-9fc2-76a85ea8bd8f service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:53.788029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebad5e-f357-4228-9fe1-e51e078566ef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:53.788177 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1326/2681] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:53.918036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1356/2682] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:53 2022] PUT /identity/v3/projects/b8cd24a2a6d14b81b8bbd5a1e97e1f91/users/2665899476e646fa96623f78d76f1c53/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:53.930197 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d8f6-c135-4f1e-bf4e-8ad29c19739b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:53.930444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d8f6-c135-4f1e-bf4e-8ad29c19739b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:53.930717 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d8f6-c135-4f1e-bf4e-8ad29c19739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:53.963636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-c9a1d8f6-c135-4f1e-bf4e-8ad29c19739b None None] MFA Rules not processed for user `2665899476e646fa96623f78d76f1c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:53.964917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-c9a1d8f6-c135-4f1e-bf4e-8ad29c19739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:54.042632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1327/2683] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:54.047025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebad5e-f357-4228-9fe1-e51e078566ef admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.124819 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebad5e-f357-4228-9fe1-e51e078566ef admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.129843 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9a63b-6a5f-4ef8-8f6e-5a76ac4bcc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.130459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9a63b-6a5f-4ef8-8f6e-5a76ac4bcc58 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.130743 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9a63b-6a5f-4ef8-8f6e-5a76ac4bcc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.131091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9a63b-6a5f-4ef8-8f6e-5a76ac4bcc58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.131712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9a63b-6a5f-4ef8-8f6e-5a76ac4bcc58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.135318 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9a63b-6a5f-4ef8-8f6e-5a76ac4bcc58 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.229152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1357/2684] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:54 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:54.234896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d8f6-c135-4f1e-bf4e-8ad29c19739b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.261147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d8f6-c135-4f1e-bf4e-8ad29c19739b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.326989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247d5a1-125d-46b3-bf26-63acbdecfee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.328024 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247d5a1-125d-46b3-bf26-63acbdecfee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.328295 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247d5a1-125d-46b3-bf26-63acbdecfee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.329783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247d5a1-125d-46b3-bf26-63acbdecfee3 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.335589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247d5a1-125d-46b3-bf26-63acbdecfee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.335589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247d5a1-125d-46b3-bf26-63acbdecfee3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.422148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1328/2685] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:54 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:54.423614 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9a63b-6a5f-4ef8-8f6e-5a76ac4bcc58 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.441677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9a63b-6a5f-4ef8-8f6e-5a76ac4bcc58 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.449695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247d5a1-125d-46b3-bf26-63acbdecfee3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.453195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0cca0-6e0d-47dd-99b1-fdddd58c5865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.454083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0cca0-6e0d-47dd-99b1-fdddd58c5865 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.454444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0cca0-6e0d-47dd-99b1-fdddd58c5865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.454793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0cca0-6e0d-47dd-99b1-fdddd58c5865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.455674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0cca0-6e0d-47dd-99b1-fdddd58c5865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.456740 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3247d5a1-125d-46b3-bf26-63acbdecfee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:54.457643 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0cca0-6e0d-47dd-99b1-fdddd58c5865 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.471878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247d5a1-125d-46b3-bf26-63acbdecfee3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.473681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1358/2686] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:54.477910 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0cca0-6e0d-47dd-99b1-fdddd58c5865 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.479376 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.480421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.480997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.481916 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] PATH_INFO: `/v3/projects/fea9f25a525b440f8ac824ff014f6c94` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.483451 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea9f25a525b440f8ac824ff014f6c94)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.492428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.500547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0cca0-6e0d-47dd-99b1-fdddd58c5865 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.516901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2f83e-cc6f-4800-a816-d7d068473e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.517856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f83e-cc6f-4800-a816-d7d068473e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.521065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f83e-cc6f-4800-a816-d7d068473e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.521065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f83e-cc6f-4800-a816-d7d068473e5e admin admin] PATH_INFO: `/v3/projects/c9c12284583f46cebfc8a53a4086b1c2/users/677b4350c7ce4c16bcd79660e0e49610/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.538027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2f83e-cc6f-4800-a816-d7d068473e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c12284583f46cebfc8a53a4086b1c2, user_id=677b4350c7ce4c16bcd79660e0e49610, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.541039 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2f83e-cc6f-4800-a816-d7d068473e5e admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.625753 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1359/2687] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:54 2022] PUT /identity/v3/projects/c9c12284583f46cebfc8a53a4086b1c2/users/677b4350c7ce4c16bcd79660e0e49610/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:54.630083 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2f83e-cc6f-4800-a816-d7d068473e5e admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.648847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea9f25a525b440f8ac824ff014f6c94', 'request_id': 'req-17fd9e95-04c7-4129-856c-38d2599600cb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:54.666159 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea9f25a525b440f8ac824ff014f6c94', 'request_id': 'req-17fd9e95-04c7-4129-856c-38d2599600cb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:54.705594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:54.735849 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2f83e-cc6f-4800-a816-d7d068473e5e admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.736985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea9f25a525b440f8ac824ff014f6c94', 'request_id': 'req-17fd9e95-04c7-4129-856c-38d2599600cb'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:54.760607 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] The token cache is being invalidate because project fea9f25a525b440f8ac824ff014f6c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:54.760607 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:54.762808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:54.767659 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1329/2688] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:54 2022] DELETE /identity/v3/projects/fea9f25a525b440f8ac824ff014f6c94 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:54.768576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.770265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:54.817746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d01e34-f61a-40c6-821f-38d6b42f8a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.818369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d01e34-f61a-40c6-821f-38d6b42f8a68 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.818651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d01e34-f61a-40c6-821f-38d6b42f8a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.818929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d01e34-f61a-40c6-821f-38d6b42f8a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.819629 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d01e34-f61a-40c6-821f-38d6b42f8a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.821244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d01e34-f61a-40c6-821f-38d6b42f8a68 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.835856 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1360/2689] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:54.843890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d01e34-f61a-40c6-821f-38d6b42f8a68 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.843890 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-d2d01e34-f61a-40c6-821f-38d6b42f8a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:54.850346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd9e95-04c7-4129-856c-38d2599600cb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.856128 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.856918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.857208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.857483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] PATH_INFO: `/v3/users/8065e12aac7c4bf494402fc6c01525cc` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.857737 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d01e34-f61a-40c6-821f-38d6b42f8a68 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.858697 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8065e12aac7c4bf494402fc6c01525cc)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.860778 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.868031 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f319bf-34f3-4ce8-bda1-195eff248998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.868648 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f319bf-34f3-4ce8-bda1-195eff248998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.868930 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f319bf-34f3-4ce8-bda1-195eff248998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.869123 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:54.869758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f319bf-34f3-4ce8-bda1-195eff248998 admin admin] PATH_INFO: `/v3/projects/c9c12284583f46cebfc8a53a4086b1c2/users/677b4350c7ce4c16bcd79660e0e49610/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.872958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f319bf-34f3-4ce8-bda1-195eff248998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c12284583f46cebfc8a53a4086b1c2, user_id=677b4350c7ce4c16bcd79660e0e49610, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.884103 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f319bf-34f3-4ce8-bda1-195eff248998 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.898732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1361/2690] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:54 2022] PUT /identity/v3/projects/c9c12284583f46cebfc8a53a4086b1c2/users/677b4350c7ce4c16bcd79660e0e49610/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:54.909723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57fc82-081c-4478-b373-9e61d255ba02 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.910077 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57fc82-081c-4478-b373-9e61d255ba02 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.910289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57fc82-081c-4478-b373-9e61d255ba02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.943798 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9c57fc82-081c-4478-b373-9e61d255ba02 None None] MFA Rules not processed for user `677b4350c7ce4c16bcd79660e0e49610`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:54.944965 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c57fc82-081c-4478-b373-9e61d255ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:55.024253 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1362/2691] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:55.036610 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57fc82-081c-4478-b373-9e61d255ba02 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.040348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9c57fc82-081c-4478-b373-9e61d255ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:55.078276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8065e12aac7c4bf494402fc6c01525cc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.114803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57fc82-081c-4478-b373-9e61d255ba02 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.114803 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16e43c-7688-41f8-b962-a931453e5c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.115490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16e43c-7688-41f8-b962-a931453e5c4c service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.115777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16e43c-7688-41f8-b962-a931453e5c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.116055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16e43c-7688-41f8-b962-a931453e5c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.117912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0d16e43c-7688-41f8-b962-a931453e5c4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:55.176907 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16e43c-7688-41f8-b962-a931453e5c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.178368 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16e43c-7688-41f8-b962-a931453e5c4c service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.181087 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8065e12aac7c4bf494402fc6c01525cc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.187482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1363/2692] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:55.189028 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8065e12aac7c4bf494402fc6c01525cc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.189845 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8065e12aac7c4bf494402fc6c01525cc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.203011 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8065e12aac7c4bf494402fc6c01525cc'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.215822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1330/2693] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:54 2022] DELETE /identity/v3/users/8065e12aac7c4bf494402fc6c01525cc => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:55.295907 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16e43c-7688-41f8-b962-a931453e5c4c service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.297663 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-0d16e43c-7688-41f8-b962-a931453e5c4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:55.373473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16e43c-7688-41f8-b962-a931453e5c4c service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.395467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:55.433563 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43af910-ac5a-49c7-9936-2f09c54e9798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.434337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43af910-ac5a-49c7-9936-2f09c54e9798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.434714 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43af910-ac5a-49c7-9936-2f09c54e9798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.435458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43af910-ac5a-49c7-9936-2f09c54e9798 admin admin] PATH_INFO: `/v3/users/7463c60513914e138878f6eaf0a87473` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.438585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43af910-ac5a-49c7-9936-2f09c54e9798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7463c60513914e138878f6eaf0a87473)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.439168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43af910-ac5a-49c7-9936-2f09c54e9798 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.686898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.688373 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:55.703111 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7ecbb-97f9-4541-a242-d537a9de8ebb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.708175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.708827 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.709107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.709391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] PATH_INFO: `/v3/projects/b86ceb3fc075474c8c8dbbcce750ccdb` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.710528 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86ceb3fc075474c8c8dbbcce750ccdb)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.712492 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.779399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d43af910-ac5a-49c7-9936-2f09c54e9798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7463c60513914e138878f6eaf0a87473'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.780047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d43af910-ac5a-49c7-9936-2f09c54e9798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7463c60513914e138878f6eaf0a87473'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.780654 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d43af910-ac5a-49c7-9936-2f09c54e9798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7463c60513914e138878f6eaf0a87473'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.903566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86ceb3fc075474c8c8dbbcce750ccdb', 'request_id': 'req-56e87433-fc36-4fff-97b5-1f355ebce50d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.909036 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86ceb3fc075474c8c8dbbcce750ccdb', 'request_id': 'req-56e87433-fc36-4fff-97b5-1f355ebce50d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.924275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d43af910-ac5a-49c7-9936-2f09c54e9798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7463c60513914e138878f6eaf0a87473'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.939101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-d43af910-ac5a-49c7-9936-2f09c54e9798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7463c60513914e138878f6eaf0a87473'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:55.951899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1364/2694] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:55 2022] DELETE /identity/v3/users/7463c60513914e138878f6eaf0a87473 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:56.039652 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86ceb3fc075474c8c8dbbcce750ccdb', 'request_id': 'req-56e87433-fc36-4fff-97b5-1f355ebce50d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:56.052685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] The token cache is being invalidate because project b86ceb3fc075474c8c8dbbcce750ccdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:56.052986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:56.053992 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:56.055856 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1331/2695] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:55 2022] DELETE /identity/v3/projects/b86ceb3fc075474c8c8dbbcce750ccdb => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:56.068700 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755721ce-edc9-4651-a61b-c770a70fd062 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.071793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755721ce-edc9-4651-a61b-c770a70fd062 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.073005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755721ce-edc9-4651-a61b-c770a70fd062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.095524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-755721ce-edc9-4651-a61b-c770a70fd062 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:56.096900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-755721ce-edc9-4651-a61b-c770a70fd062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:56.159665 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1365/2696] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:56.188693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.190197 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:56.235902 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b8b1-472a-4c85-b6c4-bdb7918a89a1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.236421 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b8b1-472a-4c85-b6c4-bdb7918a89a1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.236699 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1b8b1-472a-4c85-b6c4-bdb7918a89a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.257097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2ca1b8b1-472a-4c85-b6c4-bdb7918a89a1 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:56.258362 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2ca1b8b1-472a-4c85-b6c4-bdb7918a89a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:56.267524 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1366/2697] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:56.271793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1b8b1-472a-4c85-b6c4-bdb7918a89a1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.273243 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e87433-fc36-4fff-97b5-1f355ebce50d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.278588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.279257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.279541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.279807 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] PATH_INFO: `/v3/projects/990b2fd7ef6b43bca7f3b445f3da19f3` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.280971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] RBAC: Authorizing `identity:delete_project(project_id=990b2fd7ef6b43bca7f3b445f3da19f3)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.282011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1b8b1-472a-4c85-b6c4-bdb7918a89a1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.282882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.287573 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3361df3-4edb-48e9-ad54-868f17a282e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.288180 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3361df3-4edb-48e9-ad54-868f17a282e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.288466 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3361df3-4edb-48e9-ad54-868f17a282e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.288742 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3361df3-4edb-48e9-ad54-868f17a282e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.289401 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3361df3-4edb-48e9-ad54-868f17a282e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:56.289754 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3361df3-4edb-48e9-ad54-868f17a282e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.291384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3361df3-4edb-48e9-ad54-868f17a282e9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.303716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1367/2698] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:55:56.308878 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3361df3-4edb-48e9-ad54-868f17a282e9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.319100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3361df3-4edb-48e9-ad54-868f17a282e9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.324594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478f536-0fbd-4190-a158-64feeba36f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.325203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478f536-0fbd-4190-a158-64feeba36f30 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.325477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478f536-0fbd-4190-a158-64feeba36f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.325751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478f536-0fbd-4190-a158-64feeba36f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.326383 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478f536-0fbd-4190-a158-64feeba36f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.328329 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478f536-0fbd-4190-a158-64feeba36f30 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.422069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1368/2699] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:56 2022] POST /identity/v3/projects => generated 361 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:56.426311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478f536-0fbd-4190-a158-64feeba36f30 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.432828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990b2fd7ef6b43bca7f3b445f3da19f3', 'request_id': 'req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:56.438882 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990b2fd7ef6b43bca7f3b445f3da19f3', 'request_id': 'req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:56.492127 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478f536-0fbd-4190-a158-64feeba36f30 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.496923 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5e2c3-1b87-4546-9828-d859de9f70b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.497531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e2c3-1b87-4546-9828-d859de9f70b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.497815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e2c3-1b87-4546-9828-d859de9f70b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.498089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e2c3-1b87-4546-9828-d859de9f70b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.498718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5e2c3-1b87-4546-9828-d859de9f70b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.500688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5e2c3-1b87-4546-9828-d859de9f70b3 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.502781 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990b2fd7ef6b43bca7f3b445f3da19f3', 'request_id': 'req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:56.520316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] The token cache is being invalidate because project 990b2fd7ef6b43bca7f3b445f3da19f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:56.520613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:56.521270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9d1fc5cf-e5e1-4d7b-8028-46a1ff37224a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:56.522782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1332/2700] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:56 2022] DELETE /identity/v3/projects/990b2fd7ef6b43bca7f3b445f3da19f3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:56.528348 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3e7f-55af-4eb7-bd75-5b463fc5f88d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.528634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3e7f-55af-4eb7-bd75-5b463fc5f88d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.528908 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3e7f-55af-4eb7-bd75-5b463fc5f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.548708 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-13ce3e7f-55af-4eb7-bd75-5b463fc5f88d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:56.549904 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-13ce3e7f-55af-4eb7-bd75-5b463fc5f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:56.557896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1333/2701] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:56.565854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383e7d-cd2a-4f95-bffc-b60b5d16bcd7 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.566137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383e7d-cd2a-4f95-bffc-b60b5d16bcd7 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.566409 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383e7d-cd2a-4f95-bffc-b60b5d16bcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.586858 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-62383e7d-cd2a-4f95-bffc-b60b5d16bcd7 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:56.588797 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-62383e7d-cd2a-4f95-bffc-b60b5d16bcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:56.596622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1334/2702] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:56.606068 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1369/2703] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:56 2022] POST /identity/v3/users => generated 281 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:56.606713 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62383e7d-cd2a-4f95-bffc-b60b5d16bcd7 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.609927 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5e2c3-1b87-4546-9828-d859de9f70b3 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.611579 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8bd5e2c3-1b87-4546-9828-d859de9f70b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:56.616255 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62383e7d-cd2a-4f95-bffc-b60b5d16bcd7 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.621466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5509e-c018-4602-907d-9d3a4fde5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.622112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5509e-c018-4602-907d-9d3a4fde5541 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.622392 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5509e-c018-4602-907d-9d3a4fde5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.622665 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5509e-c018-4602-907d-9d3a4fde5541 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.623340 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5509e-c018-4602-907d-9d3a4fde5541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:56.623668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5509e-c018-4602-907d-9d3a4fde5541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.624427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5e2c3-1b87-4546-9828-d859de9f70b3 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.625789 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5509e-c018-4602-907d-9d3a4fde5541 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.629838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37339-0253-4d8b-94a5-8a204d3fee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.630443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37339-0253-4d8b-94a5-8a204d3fee50 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.630725 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37339-0253-4d8b-94a5-8a204d3fee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.630998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37339-0253-4d8b-94a5-8a204d3fee50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.631689 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37339-0253-4d8b-94a5-8a204d3fee50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.633285 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37339-0253-4d8b-94a5-8a204d3fee50 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.638250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1335/2704] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:55:56.642834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5509e-c018-4602-907d-9d3a4fde5541 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.645221 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1370/2705] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:56.651558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37339-0253-4d8b-94a5-8a204d3fee50 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.653077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5509e-c018-4602-907d-9d3a4fde5541 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.657817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2979d-4950-4a56-b857-0827df34aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.658415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2979d-4950-4a56-b857-0827df34aff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.658723 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2979d-4950-4a56-b857-0827df34aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.658974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2979d-4950-4a56-b857-0827df34aff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.659672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2979d-4950-4a56-b857-0827df34aff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.661702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2979d-4950-4a56-b857-0827df34aff6 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.661867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37339-0253-4d8b-94a5-8a204d3fee50 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.666678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a44e8c-079c-42e3-a94b-67f004a4fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.667444 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44e8c-079c-42e3-a94b-67f004a4fa27 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.667828 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44e8c-079c-42e3-a94b-67f004a4fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.668208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44e8c-079c-42e3-a94b-67f004a4fa27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.668969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a44e8c-079c-42e3-a94b-67f004a4fa27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.670770 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a44e8c-079c-42e3-a94b-67f004a4fa27 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.682846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1371/2706] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:56.687072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a44e8c-079c-42e3-a94b-67f004a4fa27 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.696917 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a44e8c-079c-42e3-a94b-67f004a4fa27 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.703418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:56.704187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0bc2c-963e-4335-a792-a1c5b64df1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.704965 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0bc2c-963e-4335-a792-a1c5b64df1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.705250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0bc2c-963e-4335-a792-a1c5b64df1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.705527 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0bc2c-963e-4335-a792-a1c5b64df1e8 admin admin] PATH_INFO: `/v3/projects/976148587b224e45a8bc514faab3390a/users/67363846ffb04d0fbc9f53f710b064b9/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.720327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0bc2c-963e-4335-a792-a1c5b64df1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976148587b224e45a8bc514faab3390a, user_id=67363846ffb04d0fbc9f53f710b064b9, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.723014 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0bc2c-963e-4335-a792-a1c5b64df1e8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.788250 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1336/2707] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:56 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:56.792443 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2979d-4950-4a56-b857-0827df34aff6 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.843812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1372/2708] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:56 2022] PUT /identity/v3/projects/976148587b224e45a8bc514faab3390a/users/67363846ffb04d0fbc9f53f710b064b9/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:56.850326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3a151-a824-448c-a91d-8dafcde8e13b None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.850620 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3a151-a824-448c-a91d-8dafcde8e13b None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.850900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3a151-a824-448c-a91d-8dafcde8e13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.856088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2979d-4950-4a56-b857-0827df34aff6 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.886895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-65a3a151-a824-448c-a91d-8dafcde8e13b None None] MFA Rules not processed for user `67363846ffb04d0fbc9f53f710b064b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:56.888179 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-65a3a151-a824-448c-a91d-8dafcde8e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:56.913632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a85085-3531-44d4-878e-c05c43fc3e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.914251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a85085-3531-44d4-878e-c05c43fc3e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.914537 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a85085-3531-44d4-878e-c05c43fc3e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.914814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a85085-3531-44d4-878e-c05c43fc3e1f admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.915480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a85085-3531-44d4-878e-c05c43fc3e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.917970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a85085-3531-44d4-878e-c05c43fc3e1f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.953459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1373/2709] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:56.990435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3a151-a824-448c-a91d-8dafcde8e13b None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.991857 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-65a3a151-a824-448c-a91d-8dafcde8e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:57.048262 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3a151-a824-448c-a91d-8dafcde8e13b None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:57.053415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1337/2710] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:56 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:55:57.053571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dad0f1-18b1-42dc-b3b3-43419fd27bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:57.053571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dad0f1-18b1-42dc-b3b3-43419fd27bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.053571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dad0f1-18b1-42dc-b3b3-43419fd27bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.053571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dad0f1-18b1-42dc-b3b3-43419fd27bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.055071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a85085-3531-44d4-878e-c05c43fc3e1f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:57.061976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dad0f1-18b1-42dc-b3b3-43419fd27bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:57.063961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dad0f1-18b1-42dc-b3b3-43419fd27bc6 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:57.065025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a85085-3531-44d4-878e-c05c43fc3e1f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:57.069936 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cba97-f680-4eb2-9b63-85c77da663d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:57.070536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cba97-f680-4eb2-9b63-85c77da663d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.070818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cba97-f680-4eb2-9b63-85c77da663d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.071127 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cba97-f680-4eb2-9b63-85c77da663d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.071994 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cba97-f680-4eb2-9b63-85c77da663d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:57.073502 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1374/2711] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:57.074379 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cba97-f680-4eb2-9b63-85c77da663d1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:57.088461 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1338/2712] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:57.089494 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dad0f1-18b1-42dc-b3b3-43419fd27bc6 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:57.090932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cba97-f680-4eb2-9b63-85c77da663d1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:57.100759 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cba97-f680-4eb2-9b63-85c77da663d1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:57.102085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dad0f1-18b1-42dc-b3b3-43419fd27bc6 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:57.105810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:57.106596 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.106862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68624e53-d734-4bfb-905d-ceabd666c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:57.107110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.107480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] PATH_INFO: `/v3/users/67363846ffb04d0fbc9f53f710b064b9` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.107583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68624e53-d734-4bfb-905d-ceabd666c0ac admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.107760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68624e53-d734-4bfb-905d-ceabd666c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.108036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68624e53-d734-4bfb-905d-ceabd666c0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.108681 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68624e53-d734-4bfb-905d-ceabd666c0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:57.109068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67363846ffb04d0fbc9f53f710b064b9)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:57.110326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68624e53-d734-4bfb-905d-ceabd666c0ac admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:57.111191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:57.120784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1375/2713] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:55:57.125081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68624e53-d734-4bfb-905d-ceabd666c0ac admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:57.135519 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68624e53-d734-4bfb-905d-ceabd666c0ac admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:57.140403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26153826-18ea-443a-ae25-387c08e61e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:57.141064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26153826-18ea-443a-ae25-387c08e61e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.141348 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26153826-18ea-443a-ae25-387c08e61e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.141623 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26153826-18ea-443a-ae25-387c08e61e88 admin admin] PATH_INFO: `/v3/projects/e6cf90df100544d3a7ad3bd6fcd0ba78/users/d152d718cad446d5bc1cea336ea8525c/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.157309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26153826-18ea-443a-ae25-387c08e61e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6cf90df100544d3a7ad3bd6fcd0ba78, user_id=d152d718cad446d5bc1cea336ea8525c, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:57.160059 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26153826-18ea-443a-ae25-387c08e61e88 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:57.226474 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:57.232977 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1376/2714] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:57 2022] PUT /identity/v3/projects/e6cf90df100544d3a7ad3bd6fcd0ba78/users/d152d718cad446d5bc1cea336ea8525c/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:57.243412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51446650-1f42-426f-952c-3a24ec2b84ad None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.243696 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51446650-1f42-426f-952c-3a24ec2b84ad None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.244023 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51446650-1f42-426f-952c-3a24ec2b84ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.271206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-51446650-1f42-426f-952c-3a24ec2b84ad None None] MFA Rules not processed for user `d152d718cad446d5bc1cea336ea8525c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:57.272477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-51446650-1f42-426f-952c-3a24ec2b84ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:57.302291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67363846ffb04d0fbc9f53f710b064b9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:57.341907 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1377/2715] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:57.346713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51446650-1f42-426f-952c-3a24ec2b84ad None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:57.408776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67363846ffb04d0fbc9f53f710b064b9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:57.412243 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51446650-1f42-426f-952c-3a24ec2b84ad None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:57.417687 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67363846ffb04d0fbc9f53f710b064b9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:57.418112 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629892c-f52e-477a-a637-6cc66a3bdc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:57.418654 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67363846ffb04d0fbc9f53f710b064b9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:57.418773 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629892c-f52e-477a-a637-6cc66a3bdc51 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.419017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629892c-f52e-477a-a637-6cc66a3bdc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.419311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629892c-f52e-477a-a637-6cc66a3bdc51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.419943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629892c-f52e-477a-a637-6cc66a3bdc51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:57.422010 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629892c-f52e-477a-a637-6cc66a3bdc51 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:57.431335 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67363846ffb04d0fbc9f53f710b064b9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:57.437554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1339/2716] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:57 2022] DELETE /identity/v3/users/67363846ffb04d0fbc9f53f710b064b9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:57.440636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:57.440636 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:57.499604 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a813c-fd73-43e0-9abd-52bd86ffa14d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:57.503346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620055b3-4dc4-4df9-b2d7-140af1b30449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:57.503957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620055b3-4dc4-4df9-b2d7-140af1b30449 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.504238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620055b3-4dc4-4df9-b2d7-140af1b30449 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.504511 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620055b3-4dc4-4df9-b2d7-140af1b30449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.506236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-620055b3-4dc4-4df9-b2d7-140af1b30449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:57.516048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1378/2717] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:57 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:57.517393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c14d6-f63d-4b4d-99fa-b57571f705f5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.517746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c14d6-f63d-4b4d-99fa-b57571f705f5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.518198 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c14d6-f63d-4b4d-99fa-b57571f705f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.537293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-778c14d6-f63d-4b4d-99fa-b57571f705f5 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:57.538507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-778c14d6-f63d-4b4d-99fa-b57571f705f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:57.574149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620055b3-4dc4-4df9-b2d7-140af1b30449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:57.575854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620055b3-4dc4-4df9-b2d7-140af1b30449 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:57.590114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1340/2718] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:57.591616 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620055b3-4dc4-4df9-b2d7-140af1b30449 service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:57.593907 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-620055b3-4dc4-4df9-b2d7-140af1b30449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:57.616149 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1379/2719] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:57.623718 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c14d6-f63d-4b4d-99fa-b57571f705f5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:57.625662 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-778c14d6-f63d-4b4d-99fa-b57571f705f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:57.679751 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620055b3-4dc4-4df9-b2d7-140af1b30449 service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:57.684811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b162647-750e-43ed-bed4-31bd9a20e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:57.685459 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162647-750e-43ed-bed4-31bd9a20e3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.685706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162647-750e-43ed-bed4-31bd9a20e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.685976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162647-750e-43ed-bed4-31bd9a20e3f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.686632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b162647-750e-43ed-bed4-31bd9a20e3f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:57.687920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c14d6-f63d-4b4d-99fa-b57571f705f5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:57.688577 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b162647-750e-43ed-bed4-31bd9a20e3f1 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:57.691909 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265277a1-a72e-4679-86c3-2362ccffe11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:57.692452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265277a1-a72e-4679-86c3-2362ccffe11f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.692736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265277a1-a72e-4679-86c3-2362ccffe11f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.693011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265277a1-a72e-4679-86c3-2362ccffe11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.703281 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265277a1-a72e-4679-86c3-2362ccffe11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:57.704782 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265277a1-a72e-4679-86c3-2362ccffe11f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:57.715097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1380/2720] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:57.834562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1341/2721] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:57 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:57.839717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265277a1-a72e-4679-86c3-2362ccffe11f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:57.849879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265277a1-a72e-4679-86c3-2362ccffe11f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:57.854545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08219f84-e8a6-4aae-8edb-a04828a8d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:57.855182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08219f84-e8a6-4aae-8edb-a04828a8d808 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.855561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08219f84-e8a6-4aae-8edb-a04828a8d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.855907 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08219f84-e8a6-4aae-8edb-a04828a8d808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.856585 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08219f84-e8a6-4aae-8edb-a04828a8d808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:57.858171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08219f84-e8a6-4aae-8edb-a04828a8d808 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:57.868244 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1381/2722] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:57.872725 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b162647-750e-43ed-bed4-31bd9a20e3f1 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:57.883556 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b162647-750e-43ed-bed4-31bd9a20e3f1 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:57.888857 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a25dd-eb86-4023-9c5b-64ac08ce48f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:57.889514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a25dd-eb86-4023-9c5b-64ac08ce48f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:57.889801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a25dd-eb86-4023-9c5b-64ac08ce48f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:57.890110 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a25dd-eb86-4023-9c5b-64ac08ce48f3 admin admin] PATH_INFO: `/v3/projects/ecc70454679b44c2a07f89ff0556323c/users/d048728afea94122b1a24fcd873a96fa/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:57.905763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a25dd-eb86-4023-9c5b-64ac08ce48f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc70454679b44c2a07f89ff0556323c, user_id=d048728afea94122b1a24fcd873a96fa, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:57.908513 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a25dd-eb86-4023-9c5b-64ac08ce48f3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:58.033096 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1342/2723] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:57 2022] PUT /identity/v3/projects/ecc70454679b44c2a07f89ff0556323c/users/d048728afea94122b1a24fcd873a96fa/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:58.037400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08219f84-e8a6-4aae-8edb-a04828a8d808 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:58.048117 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08219f84-e8a6-4aae-8edb-a04828a8d808 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:58.111141 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4096de-24e9-4390-b38e-260f61af35b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:58.112183 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4096de-24e9-4390-b38e-260f61af35b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:58.112467 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4096de-24e9-4390-b38e-260f61af35b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:58.112752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4096de-24e9-4390-b38e-260f61af35b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:58.113407 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4096de-24e9-4390-b38e-260f61af35b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:58.115020 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4096de-24e9-4390-b38e-260f61af35b7 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:58.125452 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1382/2724] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:58.130073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a25dd-eb86-4023-9c5b-64ac08ce48f3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:58.131128 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:58.141271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a25dd-eb86-4023-9c5b-64ac08ce48f3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:58.145944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba15ad-e2d5-4f49-a71c-fb3543645d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:58.146668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba15ad-e2d5-4f49-a71c-fb3543645d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:58.146875 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba15ad-e2d5-4f49-a71c-fb3543645d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:58.147192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba15ad-e2d5-4f49-a71c-fb3543645d0d admin admin] PATH_INFO: `/v3/projects/ecc70454679b44c2a07f89ff0556323c/users/d048728afea94122b1a24fcd873a96fa/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:58.149168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba15ad-e2d5-4f49-a71c-fb3543645d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc70454679b44c2a07f89ff0556323c, user_id=d048728afea94122b1a24fcd873a96fa, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:58.152007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba15ad-e2d5-4f49-a71c-fb3543645d0d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:58.162201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1343/2725] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:58 2022] PUT /identity/v3/projects/ecc70454679b44c2a07f89ff0556323c/users/d048728afea94122b1a24fcd873a96fa/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:58.174147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a94d-9551-45ee-8acb-92b87bd73355 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:58.174632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a94d-9551-45ee-8acb-92b87bd73355 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:58.174905 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a94d-9551-45ee-8acb-92b87bd73355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:58.177001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba15ad-e2d5-4f49-a71c-fb3543645d0d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:58.185830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-73ba15ad-e2d5-4f49-a71c-fb3543645d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:58.213268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1a18a94d-9551-45ee-8acb-92b87bd73355 None None] MFA Rules not processed for user `d048728afea94122b1a24fcd873a96fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:58.214497 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1a18a94d-9551-45ee-8acb-92b87bd73355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:58.255152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba15ad-e2d5-4f49-a71c-fb3543645d0d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:58.260421 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:58.261162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:58.261435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:58.261706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] PATH_INFO: `/v3/projects/976148587b224e45a8bc514faab3390a` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:58.262853 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=976148587b224e45a8bc514faab3390a)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:58.264828 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:58.283227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1383/2726] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:55:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:58.294968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18a94d-9551-45ee-8acb-92b87bd73355 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:58.296384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1a18a94d-9551-45ee-8acb-92b87bd73355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:58.353560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18a94d-9551-45ee-8acb-92b87bd73355 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:58.357587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f471e-5a9a-4b9a-8706-9f4e7e9d9092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:58.358206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f471e-5a9a-4b9a-8706-9f4e7e9d9092 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:58.358479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f471e-5a9a-4b9a-8706-9f4e7e9d9092 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:58.358750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f471e-5a9a-4b9a-8706-9f4e7e9d9092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:58.369438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f471e-5a9a-4b9a-8706-9f4e7e9d9092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:58.370942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f471e-5a9a-4b9a-8706-9f4e7e9d9092 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:58.374582 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976148587b224e45a8bc514faab3390a', 'request_id': 'req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:58.380841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1384/2727] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:58.382170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976148587b224e45a8bc514faab3390a', 'request_id': 'req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:58.434471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976148587b224e45a8bc514faab3390a', 'request_id': 'req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:58.445892 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] The token cache is being invalidate because project 976148587b224e45a8bc514faab3390a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:58.446181 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:58.446818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:58.448989 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1344/2728] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:58 2022] DELETE /identity/v3/projects/976148587b224e45a8bc514faab3390a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:58.614304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f471e-5a9a-4b9a-8706-9f4e7e9d9092 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:58.624321 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f471e-5a9a-4b9a-8706-9f4e7e9d9092 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:58.634626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:58.683423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd187064-9d2f-463e-8c73-ddfe56632923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:58.684058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd187064-9d2f-463e-8c73-ddfe56632923 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:58.684342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd187064-9d2f-463e-8c73-ddfe56632923 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:58.684621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd187064-9d2f-463e-8c73-ddfe56632923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:58.686449 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cd187064-9d2f-463e-8c73-ddfe56632923 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:58.747618 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd187064-9d2f-463e-8c73-ddfe56632923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:58.749081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd187064-9d2f-463e-8c73-ddfe56632923 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:58.757865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1385/2729] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:58.816812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:59.438070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:59.439538 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:59.452436 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aa15d-f954-4e79-9fc7-6a6d49db1ec4 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:59.456412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b95ed-f938-43ab-a979-b8c183b632fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:59.457023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b95ed-f938-43ab-a979-b8c183b632fd service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:59.457307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b95ed-f938-43ab-a979-b8c183b632fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:59.457584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b95ed-f938-43ab-a979-b8c183b632fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:59.459351 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-182b95ed-f938-43ab-a979-b8c183b632fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:59.531705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b95ed-f938-43ab-a979-b8c183b632fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:59.533605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b95ed-f938-43ab-a979-b8c183b632fd service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:59.544693 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1345/2730] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:59.992308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:00.083756 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:00.398220 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:00.670073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:01.226598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:01.929696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:02.062825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:02.409441 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:02.497091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:02.691164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=100 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:04.721489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd187064-9d2f-463e-8c73-ddfe56632923 service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:04.724274 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cd187064-9d2f-463e-8c73-ddfe56632923 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:04.886474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd187064-9d2f-463e-8c73-ddfe56632923 service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:04.891480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:04.892194 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:04.892477 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:04.892755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] PATH_INFO: `/v3/users/a1c1954116f148b5952d407d8a4c06a0` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:04.894093 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c1954116f148b5952d407d8a4c06a0)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:04.896271 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:05.175967 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:05.189883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c1954116f148b5952d407d8a4c06a0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:05.190592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c1954116f148b5952d407d8a4c06a0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:05.191273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c1954116f148b5952d407d8a4c06a0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:05.311999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c1954116f148b5952d407d8a4c06a0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:05.328748 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c1954116f148b5952d407d8a4c06a0'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:05.344836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1386/2731] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:04 2022] DELETE /identity/v3/users/a1c1954116f148b5952d407d8a4c06a0 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:05.349341 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83373940-ba00-4373-b63c-bed095532a61 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.349807 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83373940-ba00-4373-b63c-bed095532a61 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.349921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83373940-ba00-4373-b63c-bed095532a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.378928 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-83373940-ba00-4373-b63c-bed095532a61 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:05.380244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-83373940-ba00-4373-b63c-bed095532a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:05.446525 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1346/2732] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:05.457455 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:05.459131 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:05.547099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2970ca4-684e-480b-94fa-15b134912386 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:05.555708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c9005-72e4-4a30-943a-9650c71cedec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:05.555708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c9005-72e4-4a30-943a-9650c71cedec service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.555708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c9005-72e4-4a30-943a-9650c71cedec service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.555708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c9005-72e4-4a30-943a-9650c71cedec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.562562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c9005-72e4-4a30-943a-9650c71cedec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:05.564327 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c9005-72e4-4a30-943a-9650c71cedec service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:05.578731 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1387/2733] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:06.097863 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83373940-ba00-4373-b63c-bed095532a61 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:06.099412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-83373940-ba00-4373-b63c-bed095532a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:06.111627 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83373940-ba00-4373-b63c-bed095532a61 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:06.116399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:06.117065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:06.117326 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:06.117614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] PATH_INFO: `/v3/projects/b248f42dc69c4252937debf5434bd163` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:06.118945 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b248f42dc69c4252937debf5434bd163)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:06.120870 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:06.245859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b248f42dc69c4252937debf5434bd163', 'request_id': 'req-4c2ebbaa-03b0-439a-ba4e-252b40166f93'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:06.249722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:06.252251 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b248f42dc69c4252937debf5434bd163', 'request_id': 'req-4c2ebbaa-03b0-439a-ba4e-252b40166f93'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:06.331151 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b248f42dc69c4252937debf5434bd163', 'request_id': 'req-4c2ebbaa-03b0-439a-ba4e-252b40166f93'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:06.343401 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] The token cache is being invalidate because project b248f42dc69c4252937debf5434bd163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:06.343727 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:06.344372 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:06.345874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1347/2734] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:06 2022] DELETE /identity/v3/projects/b248f42dc69c4252937debf5434bd163 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:06.349978 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c9005-72e4-4a30-943a-9650c71cedec service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:06.361891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c9005-72e4-4a30-943a-9650c71cedec service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:06.419513 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:06.420150 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:06.420429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:06.420703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] PATH_INFO: `/v3/users/2665899476e646fa96623f78d76f1c53` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:06.421832 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2665899476e646fa96623f78d76f1c53)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:06.423794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:06.878800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:06.881230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2665899476e646fa96623f78d76f1c53'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:06.881892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2665899476e646fa96623f78d76f1c53'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:06.882506 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2665899476e646fa96623f78d76f1c53'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:06.981156 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2665899476e646fa96623f78d76f1c53'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:06.993812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2665899476e646fa96623f78d76f1c53'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:07.005783 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1388/2735] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:06 2022] DELETE /identity/v3/users/2665899476e646fa96623f78d76f1c53 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:07.566550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:07.568024 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:07.581564 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ebbaa-03b0-439a-ba4e-252b40166f93 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:07.647503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:07.647503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:07.647503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:07.647503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] PATH_INFO: `/v3/projects/b8cd24a2a6d14b81b8bbd5a1e97e1f91` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:07.648047 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8cd24a2a6d14b81b8bbd5a1e97e1f91)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:07.652917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:07.855311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8cd24a2a6d14b81b8bbd5a1e97e1f91', 'request_id': 'req-3c2257b2-99b9-4bf1-8f03-ac31b4995774'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:07.860878 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8cd24a2a6d14b81b8bbd5a1e97e1f91', 'request_id': 'req-3c2257b2-99b9-4bf1-8f03-ac31b4995774'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:07.965651 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8cd24a2a6d14b81b8bbd5a1e97e1f91', 'request_id': 'req-3c2257b2-99b9-4bf1-8f03-ac31b4995774'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:07.979133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] The token cache is being invalidate because project b8cd24a2a6d14b81b8bbd5a1e97e1f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:07.979464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:07.980140 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:07.981677 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1348/2736] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:07 2022] DELETE /identity/v3/projects/b8cd24a2a6d14b81b8bbd5a1e97e1f91 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:07.985789 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:07.987267 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:08.004764 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99f364-77a5-42f7-8ad4-89d36cc66eef admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:08.064189 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:08.064883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:08.065159 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:08.065438 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] PATH_INFO: `/v3/users/677b4350c7ce4c16bcd79660e0e49610` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:08.066568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=677b4350c7ce4c16bcd79660e0e49610)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:08.068531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:08.272592 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677b4350c7ce4c16bcd79660e0e49610'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:08.273287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677b4350c7ce4c16bcd79660e0e49610'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:08.273903 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677b4350c7ce4c16bcd79660e0e49610'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:08.365450 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677b4350c7ce4c16bcd79660e0e49610'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:08.380065 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677b4350c7ce4c16bcd79660e0e49610'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:08.394273 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1389/2737] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:07 2022] DELETE /identity/v3/users/677b4350c7ce4c16bcd79660e0e49610 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:08.520058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:08.521530 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:08.542518 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2257b2-99b9-4bf1-8f03-ac31b4995774 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:08.637974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c505b-afde-4a9b-ba95-5cab50945461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:08.638716 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c505b-afde-4a9b-ba95-5cab50945461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:08.638957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c505b-afde-4a9b-ba95-5cab50945461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:08.639359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c505b-afde-4a9b-ba95-5cab50945461 admin admin] PATH_INFO: `/v3/users/d152d718cad446d5bc1cea336ea8525c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:08.640799 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c505b-afde-4a9b-ba95-5cab50945461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d152d718cad446d5bc1cea336ea8525c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:08.642783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c505b-afde-4a9b-ba95-5cab50945461 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:08.660589 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:08.995409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:08.995901 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:09.009808 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d751e-f5a0-41e9-9b46-1abd7a81c1b2 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:09.014942 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:09.015951 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:09.016346 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:09.016732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] PATH_INFO: `/v3/projects/c9c12284583f46cebfc8a53a4086b1c2` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:09.017905 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c12284583f46cebfc8a53a4086b1c2)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:09.019918 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:09.043099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-833c505b-afde-4a9b-ba95-5cab50945461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd152d718cad446d5bc1cea336ea8525c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:09.172020 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:09.187632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c12284583f46cebfc8a53a4086b1c2', 'request_id': 'req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:09.203979 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-833c505b-afde-4a9b-ba95-5cab50945461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd152d718cad446d5bc1cea336ea8525c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:09.211840 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-833c505b-afde-4a9b-ba95-5cab50945461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd152d718cad446d5bc1cea336ea8525c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:09.212522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-833c505b-afde-4a9b-ba95-5cab50945461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd152d718cad446d5bc1cea336ea8525c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:09.225162 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-833c505b-afde-4a9b-ba95-5cab50945461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd152d718cad446d5bc1cea336ea8525c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:09.232465 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1349/2738] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:08 2022] DELETE /identity/v3/users/d152d718cad446d5bc1cea336ea8525c => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:09.236925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21189a7-defa-40e0-b312-382feae463c6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:09.237866 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21189a7-defa-40e0-b312-382feae463c6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:09.238147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21189a7-defa-40e0-b312-382feae463c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:09.258466 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-b21189a7-defa-40e0-b312-382feae463c6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:09.259896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b21189a7-defa-40e0-b312-382feae463c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:09.319184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1350/2739] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:09.329567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21189a7-defa-40e0-b312-382feae463c6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:09.330991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b21189a7-defa-40e0-b312-382feae463c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:09.336540 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c12284583f46cebfc8a53a4086b1c2', 'request_id': 'req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:09.343868 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c12284583f46cebfc8a53a4086b1c2', 'request_id': 'req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:09.356218 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] The token cache is being invalidate because project c9c12284583f46cebfc8a53a4086b1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:09.360090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:09.360090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8f2feb7d-fcf4-47c9-91f7-2356d3c2b37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:09.360090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1390/2740] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:08 2022] DELETE /identity/v3/projects/c9c12284583f46cebfc8a53a4086b1c2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:09.363865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606971d-80c3-48b8-825c-72b50a4e3ce5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:09.364142 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606971d-80c3-48b8-825c-72b50a4e3ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:09.364426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606971d-80c3-48b8-825c-72b50a4e3ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:09.400825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21189a7-defa-40e0-b312-382feae463c6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:09.404629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e4f68-7ba7-402f-bdc9-32d3f09ba4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:09.405236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4f68-7ba7-402f-bdc9-32d3f09ba4dc service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:09.405513 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4f68-7ba7-402f-bdc9-32d3f09ba4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:09.405784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4f68-7ba7-402f-bdc9-32d3f09ba4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:09.407520 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-253e4f68-7ba7-402f-bdc9-32d3f09ba4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:09.420825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e4f68-7ba7-402f-bdc9-32d3f09ba4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:09.421084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5606971d-80c3-48b8-825c-72b50a4e3ce5 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:09.422621 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5606971d-80c3-48b8-825c-72b50a4e3ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:09.423684 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e4f68-7ba7-402f-bdc9-32d3f09ba4dc service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:09.431099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1391/2741] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:09.435447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1351/2742] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:09.440568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cdf5c-8113-40b7-b217-781d487e5e1a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:09.440858 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cdf5c-8113-40b7-b217-781d487e5e1a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:09.441138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cdf5c-8113-40b7-b217-781d487e5e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:09.462645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-c09cdf5c-8113-40b7-b217-781d487e5e1a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:09.463974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-c09cdf5c-8113-40b7-b217-781d487e5e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:09.473089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1392/2743] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:09.477103 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e4f68-7ba7-402f-bdc9-32d3f09ba4dc service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:09.488880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e4f68-7ba7-402f-bdc9-32d3f09ba4dc service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:09.494549 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdc484-d0f3-4b7c-ac0f-e9f73e407d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:09.495767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdc484-d0f3-4b7c-ac0f-e9f73e407d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:09.495767 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdc484-d0f3-4b7c-ac0f-e9f73e407d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:09.496024 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdc484-d0f3-4b7c-ac0f-e9f73e407d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:09.496533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdc484-d0f3-4b7c-ac0f-e9f73e407d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:09.496855 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdc484-d0f3-4b7c-ac0f-e9f73e407d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:09.498546 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdc484-d0f3-4b7c-ac0f-e9f73e407d15 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:09.514591 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1352/2744] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:56:09.520461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cdf5c-8113-40b7-b217-781d487e5e1a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:09.530703 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cdf5c-8113-40b7-b217-781d487e5e1a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:09.535577 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff268c0-dca8-43fa-b894-e454e56f368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:09.536211 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff268c0-dca8-43fa-b894-e454e56f368c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:09.536490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff268c0-dca8-43fa-b894-e454e56f368c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:09.536786 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff268c0-dca8-43fa-b894-e454e56f368c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:09.537461 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff268c0-dca8-43fa-b894-e454e56f368c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:09.539462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff268c0-dca8-43fa-b894-e454e56f368c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:09.646367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1393/2745] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:09 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:09.648077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdc484-d0f3-4b7c-ac0f-e9f73e407d15 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:09.660254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdc484-d0f3-4b7c-ac0f-e9f73e407d15 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:09.683937 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:09.744804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4772d01-beee-4edd-9c5a-9c6e67e2ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:09.745483 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4772d01-beee-4edd-9c5a-9c6e67e2ac71 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:09.745836 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4772d01-beee-4edd-9c5a-9c6e67e2ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:09.746174 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4772d01-beee-4edd-9c5a-9c6e67e2ac71 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:09.746865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4772d01-beee-4edd-9c5a-9c6e67e2ac71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:09.749137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4772d01-beee-4edd-9c5a-9c6e67e2ac71 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:09.850208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1353/2746] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:09 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:09.854747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff268c0-dca8-43fa-b894-e454e56f368c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:09.865235 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff268c0-dca8-43fa-b894-e454e56f368c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:09.871002 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73653c6e-77a7-4f99-b78e-cd6c66397ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:09.871581 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73653c6e-77a7-4f99-b78e-cd6c66397ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:09.871853 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73653c6e-77a7-4f99-b78e-cd6c66397ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:09.872152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73653c6e-77a7-4f99-b78e-cd6c66397ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:09.872799 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73653c6e-77a7-4f99-b78e-cd6c66397ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:09.874406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73653c6e-77a7-4f99-b78e-cd6c66397ff5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:09.885067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1394/2747] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:09.889158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4772d01-beee-4edd-9c5a-9c6e67e2ac71 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:09.899432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4772d01-beee-4edd-9c5a-9c6e67e2ac71 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:09.904932 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef73f6-bb36-409c-a108-93e6a53f35c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:09.905096 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef73f6-bb36-409c-a108-93e6a53f35c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:09.905226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef73f6-bb36-409c-a108-93e6a53f35c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:09.905497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef73f6-bb36-409c-a108-93e6a53f35c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:09.906136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef73f6-bb36-409c-a108-93e6a53f35c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:09.907873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef73f6-bb36-409c-a108-93e6a53f35c7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:09.918399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1354/2748] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:09.922485 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73653c6e-77a7-4f99-b78e-cd6c66397ff5 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:09.933124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73653c6e-77a7-4f99-b78e-cd6c66397ff5 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:09.938017 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40696e14-1db4-4832-9415-fda18799d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:09.938678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40696e14-1db4-4832-9415-fda18799d6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:09.938966 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40696e14-1db4-4832-9415-fda18799d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:09.939289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40696e14-1db4-4832-9415-fda18799d6eb admin admin] PATH_INFO: `/v3/projects/a52d8b4f0a9f40229108a34062ac991d/users/1a776c4ad92d43f99daee7b658aaae4c/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:09.954337 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40696e14-1db4-4832-9415-fda18799d6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52d8b4f0a9f40229108a34062ac991d, user_id=1a776c4ad92d43f99daee7b658aaae4c, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:09.957055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40696e14-1db4-4832-9415-fda18799d6eb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:10.005545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef73f6-bb36-409c-a108-93e6a53f35c7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:10.008208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-24ef73f6-bb36-409c-a108-93e6a53f35c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:10.020458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef73f6-bb36-409c-a108-93e6a53f35c7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:10.027099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:10.027760 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:10.028048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:10.028322 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] PATH_INFO: `/v3/projects/e6cf90df100544d3a7ad3bd6fcd0ba78` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:10.029694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6cf90df100544d3a7ad3bd6fcd0ba78)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:10.031877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:10.078363 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1395/2749] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:09 2022] PUT /identity/v3/projects/a52d8b4f0a9f40229108a34062ac991d/users/1a776c4ad92d43f99daee7b658aaae4c/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:10.089884 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad4c3-1a81-4dcf-b551-746aa6478c8e None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:10.090144 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad4c3-1a81-4dcf-b551-746aa6478c8e None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:10.090425 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad4c3-1a81-4dcf-b551-746aa6478c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:10.130113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-50fad4c3-1a81-4dcf-b551-746aa6478c8e None None] MFA Rules not processed for user `1a776c4ad92d43f99daee7b658aaae4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:10.131416 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-50fad4c3-1a81-4dcf-b551-746aa6478c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:10.197453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1396/2750] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:10.209733 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad4c3-1a81-4dcf-b551-746aa6478c8e None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:10.211486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-50fad4c3-1a81-4dcf-b551-746aa6478c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:10.220114 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6cf90df100544d3a7ad3bd6fcd0ba78', 'request_id': 'req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.225619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:10.226316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6cf90df100544d3a7ad3bd6fcd0ba78', 'request_id': 'req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.270231 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad4c3-1a81-4dcf-b551-746aa6478c8e None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:10.320668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6cf90df100544d3a7ad3bd6fcd0ba78', 'request_id': 'req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.321884 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b708f-61ae-44be-a508-7793a1263947 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6955fc5b81a040f686e21621ea968a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:10.322757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b708f-61ae-44be-a508-7793a1263947 service glance] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:10.323109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b708f-61ae-44be-a508-7793a1263947 service glance] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:10.330286 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b708f-61ae-44be-a508-7793a1263947 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:10.335031 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] The token cache is being invalidate because project e6cf90df100544d3a7ad3bd6fcd0ba78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:10.335346 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.336018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.338003 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1355/2751] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:10 2022] DELETE /identity/v3/projects/e6cf90df100544d3a7ad3bd6fcd0ba78 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:10.342176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:10.343754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:10.382303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b708f-61ae-44be-a508-7793a1263947 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:10.384100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b708f-61ae-44be-a508-7793a1263947 service glance] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:10.394402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1397/2752] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:10.410952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b873908-f92d-4f09-b3e3-c1ab27cadb4d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:10.417345 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ee24c-2692-4ff0-878a-8a7c4c3df9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:10.418270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ee24c-2692-4ff0-878a-8a7c4c3df9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:10.418270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ee24c-2692-4ff0-878a-8a7c4c3df9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:10.418586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ee24c-2692-4ff0-878a-8a7c4c3df9a3 admin admin] PATH_INFO: `/v3/users/d048728afea94122b1a24fcd873a96fa` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:10.419951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ee24c-2692-4ff0-878a-8a7c4c3df9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d048728afea94122b1a24fcd873a96fa)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:10.422056 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ee24c-2692-4ff0-878a-8a7c4c3df9a3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:10.554319 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:10.654048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2e5ee24c-2692-4ff0-878a-8a7c4c3df9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd048728afea94122b1a24fcd873a96fa'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.757694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2e5ee24c-2692-4ff0-878a-8a7c4c3df9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd048728afea94122b1a24fcd873a96fa'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.765703 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2e5ee24c-2692-4ff0-878a-8a7c4c3df9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd048728afea94122b1a24fcd873a96fa'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.766411 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2e5ee24c-2692-4ff0-878a-8a7c4c3df9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd048728afea94122b1a24fcd873a96fa'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.778786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2e5ee24c-2692-4ff0-878a-8a7c4c3df9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd048728afea94122b1a24fcd873a96fa'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.785091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1356/2753] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:10 2022] DELETE /identity/v3/users/d048728afea94122b1a24fcd873a96fa => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:11.233825 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b708f-61ae-44be-a508-7793a1263947 service glance] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.247448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b708f-61ae-44be-a508-7793a1263947 service glance] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:11.322750 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:11.323426 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.323724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.324574 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] PATH_INFO: `/v3/projects/ecc70454679b44c2a07f89ff0556323c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.325716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc70454679b44c2a07f89ff0556323c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:11.327751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:11.354062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:11.448424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc70454679b44c2a07f89ff0556323c', 'request_id': 'req-f522d25e-b56f-4189-8697-8a4bb6af8508'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.552234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc70454679b44c2a07f89ff0556323c', 'request_id': 'req-f522d25e-b56f-4189-8697-8a4bb6af8508'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.558784 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc70454679b44c2a07f89ff0556323c', 'request_id': 'req-f522d25e-b56f-4189-8697-8a4bb6af8508'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.569948 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] The token cache is being invalidate because project ecc70454679b44c2a07f89ff0556323c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:11.570266 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.570869 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f522d25e-b56f-4189-8697-8a4bb6af8508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.572655 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1398/2754] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:11 2022] DELETE /identity/v3/projects/ecc70454679b44c2a07f89ff0556323c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:11.577680 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dd4a-89b5-4667-8b97-f085e50a5157 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.577970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dd4a-89b5-4667-8b97-f085e50a5157 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.578238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dd4a-89b5-4667-8b97-f085e50a5157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.598234 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-4b75dd4a-89b5-4667-8b97-f085e50a5157 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:11.599628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-4b75dd4a-89b5-4667-8b97-f085e50a5157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:11.661580 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1357/2755] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:11.669928 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c0ad8-e7d3-423f-bc04-368a8c850437 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.672152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c0ad8-e7d3-423f-bc04-368a8c850437 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.672152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c0ad8-e7d3-423f-bc04-368a8c850437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.690788 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-749c0ad8-e7d3-423f-bc04-368a8c850437 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:11.692084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-749c0ad8-e7d3-423f-bc04-368a8c850437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:11.700567 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1399/2756] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:11.705093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75dd4a-89b5-4667-8b97-f085e50a5157 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.715460 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75dd4a-89b5-4667-8b97-f085e50a5157 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:11.719996 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca505ccd-e863-460b-a378-8cbc9c1a1253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:11.728475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca505ccd-e863-460b-a378-8cbc9c1a1253 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.728475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca505ccd-e863-460b-a378-8cbc9c1a1253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.728475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca505ccd-e863-460b-a378-8cbc9c1a1253 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.728475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca505ccd-e863-460b-a378-8cbc9c1a1253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:11.728475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca505ccd-e863-460b-a378-8cbc9c1a1253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:11.728475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca505ccd-e863-460b-a378-8cbc9c1a1253 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:11.735658 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1358/2757] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:11.740058 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c0ad8-e7d3-423f-bc04-368a8c850437 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.749558 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c0ad8-e7d3-423f-bc04-368a8c850437 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:11.754278 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd894d5-e0dd-4f5e-9430-4f887d5fa6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:11.754883 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd894d5-e0dd-4f5e-9430-4f887d5fa6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.755210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd894d5-e0dd-4f5e-9430-4f887d5fa6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.755473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd894d5-e0dd-4f5e-9430-4f887d5fa6e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.756115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd894d5-e0dd-4f5e-9430-4f887d5fa6e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:11.758220 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd894d5-e0dd-4f5e-9430-4f887d5fa6e9 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:11.949719 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1400/2758] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:11 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:11.953834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca505ccd-e863-460b-a378-8cbc9c1a1253 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.964425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca505ccd-e863-460b-a378-8cbc9c1a1253 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.030191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81db02-6615-4f32-bc89-626665ae75f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.030839 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81db02-6615-4f32-bc89-626665ae75f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.031197 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81db02-6615-4f32-bc89-626665ae75f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.031515 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81db02-6615-4f32-bc89-626665ae75f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.032323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81db02-6615-4f32-bc89-626665ae75f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.034706 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81db02-6615-4f32-bc89-626665ae75f2 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.154068 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1359/2759] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:11 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:12.158628 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd894d5-e0dd-4f5e-9430-4f887d5fa6e9 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.170397 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd894d5-e0dd-4f5e-9430-4f887d5fa6e9 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.175375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0e918-a941-4c68-86cc-94012e440d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.176074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0e918-a941-4c68-86cc-94012e440d05 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.176397 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0e918-a941-4c68-86cc-94012e440d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.176713 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0e918-a941-4c68-86cc-94012e440d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.177398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0e918-a941-4c68-86cc-94012e440d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.179206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0e918-a941-4c68-86cc-94012e440d05 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.189649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1401/2760] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:12.193766 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81db02-6615-4f32-bc89-626665ae75f2 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.205001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81db02-6615-4f32-bc89-626665ae75f2 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.210055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74776a1-8b6f-449f-b60d-b07f0823588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.210726 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74776a1-8b6f-449f-b60d-b07f0823588a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.211015 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74776a1-8b6f-449f-b60d-b07f0823588a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.211324 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74776a1-8b6f-449f-b60d-b07f0823588a admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.212861 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74776a1-8b6f-449f-b60d-b07f0823588a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.214746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74776a1-8b6f-449f-b60d-b07f0823588a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.226977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1360/2761] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:12.231008 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0e918-a941-4c68-86cc-94012e440d05 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.241240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0e918-a941-4c68-86cc-94012e440d05 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.246043 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b920a-f9d0-4e65-88a2-26bd1ec20c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.246716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b920a-f9d0-4e65-88a2-26bd1ec20c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.246999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b920a-f9d0-4e65-88a2-26bd1ec20c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.247308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b920a-f9d0-4e65-88a2-26bd1ec20c65 admin admin] PATH_INFO: `/v3/projects/05e90a7b7bc84c669ec34307db7b59b2/users/05e7aaecda2341d08ad6d3a6c919dc74/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.262625 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b920a-f9d0-4e65-88a2-26bd1ec20c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e90a7b7bc84c669ec34307db7b59b2, user_id=05e7aaecda2341d08ad6d3a6c919dc74, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.265590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b920a-f9d0-4e65-88a2-26bd1ec20c65 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.344985 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1402/2762] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:12 2022] PUT /identity/v3/projects/05e90a7b7bc84c669ec34307db7b59b2/users/05e7aaecda2341d08ad6d3a6c919dc74/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:12.357818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f33d-6913-4fff-ae6c-12caddefad17 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.358314 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f33d-6913-4fff-ae6c-12caddefad17 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.358661 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f33d-6913-4fff-ae6c-12caddefad17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.380380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:12.389968 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-7349f33d-6913-4fff-ae6c-12caddefad17 None None] MFA Rules not processed for user `05e7aaecda2341d08ad6d3a6c919dc74`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:12.391235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7349f33d-6913-4fff-ae6c-12caddefad17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:12.460426 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1361/2763] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:12.465047 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b920a-f9d0-4e65-88a2-26bd1ec20c65 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.530111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b920a-f9d0-4e65-88a2-26bd1ec20c65 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.535016 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32577404-f72b-47d3-b826-795d7365379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.535755 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32577404-f72b-47d3-b826-795d7365379c admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.536143 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32577404-f72b-47d3-b826-795d7365379c admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.536424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32577404-f72b-47d3-b826-795d7365379c admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.537152 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32577404-f72b-47d3-b826-795d7365379c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.542011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32577404-f72b-47d3-b826-795d7365379c admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.710106 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1403/2764] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:12 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:12.714151 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f33d-6913-4fff-ae6c-12caddefad17 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.725757 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f33d-6913-4fff-ae6c-12caddefad17 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.783597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3e49-3612-483a-bdd7-e69a338983d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.784213 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3e49-3612-483a-bdd7-e69a338983d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.784495 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3e49-3612-483a-bdd7-e69a338983d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.784771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3e49-3612-483a-bdd7-e69a338983d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.785416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e3e49-3612-483a-bdd7-e69a338983d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.787485 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e3e49-3612-483a-bdd7-e69a338983d4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.000256 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1362/2765] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:12 2022] POST /identity/v3/users => generated 300 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:13.004166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32577404-f72b-47d3-b826-795d7365379c admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.014804 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32577404-f72b-47d3-b826-795d7365379c admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.019521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd85d1-d031-400c-bfff-9fbe367da881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.020260 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd85d1-d031-400c-bfff-9fbe367da881 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.020392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd85d1-d031-400c-bfff-9fbe367da881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.020712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd85d1-d031-400c-bfff-9fbe367da881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.021367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd85d1-d031-400c-bfff-9fbe367da881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.022987 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd85d1-d031-400c-bfff-9fbe367da881 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.034205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1404/2766] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:13.038713 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3e49-3612-483a-bdd7-e69a338983d4 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.049576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3e49-3612-483a-bdd7-e69a338983d4 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.054280 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04e8e0-d0fd-4fae-8df1-326780f64e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.054986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04e8e0-d0fd-4fae-8df1-326780f64e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.055311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04e8e0-d0fd-4fae-8df1-326780f64e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.055591 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04e8e0-d0fd-4fae-8df1-326780f64e50 admin admin] PATH_INFO: `/v3/projects/f3205c10838e4326a3b8dd255f34ebaa/users/af2fb2051c514996b2e0f9f0f1c6e511/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.071413 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04e8e0-d0fd-4fae-8df1-326780f64e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3205c10838e4326a3b8dd255f34ebaa, user_id=af2fb2051c514996b2e0f9f0f1c6e511, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.074356 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04e8e0-d0fd-4fae-8df1-326780f64e50 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.160263 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1363/2767] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:13 2022] PUT /identity/v3/projects/f3205c10838e4326a3b8dd255f34ebaa/users/af2fb2051c514996b2e0f9f0f1c6e511/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:13.164402 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd85d1-d031-400c-bfff-9fbe367da881 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.175341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd85d1-d031-400c-bfff-9fbe367da881 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.193637 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:13.233168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff039e-6ef2-4ff0-b3fc-f7f0a8a9978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.233866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff039e-6ef2-4ff0-b3fc-f7f0a8a9978f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.235836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff039e-6ef2-4ff0-b3fc-f7f0a8a9978f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.235836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff039e-6ef2-4ff0-b3fc-f7f0a8a9978f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.235836 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff039e-6ef2-4ff0-b3fc-f7f0a8a9978f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.239097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff039e-6ef2-4ff0-b3fc-f7f0a8a9978f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.247694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1405/2768] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:13.251829 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04e8e0-d0fd-4fae-8df1-326780f64e50 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.262107 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04e8e0-d0fd-4fae-8df1-326780f64e50 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.266847 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8b09c-d8f9-4b19-b027-1618696c2d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.267554 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8b09c-d8f9-4b19-b027-1618696c2d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.267835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8b09c-d8f9-4b19-b027-1618696c2d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.268109 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8b09c-d8f9-4b19-b027-1618696c2d6e admin admin] PATH_INFO: `/v3/projects/f3205c10838e4326a3b8dd255f34ebaa/users/af2fb2051c514996b2e0f9f0f1c6e511/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.270093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8b09c-d8f9-4b19-b027-1618696c2d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3205c10838e4326a3b8dd255f34ebaa, user_id=af2fb2051c514996b2e0f9f0f1c6e511, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.272905 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8b09c-d8f9-4b19-b027-1618696c2d6e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.284264 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1364/2769] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:13 2022] PUT /identity/v3/projects/f3205c10838e4326a3b8dd255f34ebaa/users/af2fb2051c514996b2e0f9f0f1c6e511/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:13.296481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30415-d44c-43a4-99d0-3ddb958c8f15 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.296766 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30415-d44c-43a4-99d0-3ddb958c8f15 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.297042 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30415-d44c-43a4-99d0-3ddb958c8f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.329295 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-89b30415-d44c-43a4-99d0-3ddb958c8f15 None None] MFA Rules not processed for user `af2fb2051c514996b2e0f9f0f1c6e511`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:13.330569 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-89b30415-d44c-43a4-99d0-3ddb958c8f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:13.403091 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1406/2770] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:13.414105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8b09c-d8f9-4b19-b027-1618696c2d6e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.416442 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ded8b09c-d8f9-4b19-b027-1618696c2d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:13.483437 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8b09c-d8f9-4b19-b027-1618696c2d6e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.487362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602b534-670e-4ee2-be2e-0487440affd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.487987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602b534-670e-4ee2-be2e-0487440affd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.488269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602b534-670e-4ee2-be2e-0487440affd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.488545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602b534-670e-4ee2-be2e-0487440affd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.494835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:13.498697 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602b534-670e-4ee2-be2e-0487440affd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.500207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602b534-670e-4ee2-be2e-0487440affd7 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.510612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1365/2771] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:13.578952 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b30415-d44c-43a4-99d0-3ddb958c8f15 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.644277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b30415-d44c-43a4-99d0-3ddb958c8f15 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.650990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.651693 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.652121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.652536 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] PATH_INFO: `/v3/users/05e7aaecda2341d08ad6d3a6c919dc74` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.653698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e7aaecda2341d08ad6d3a6c919dc74)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.655687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.909004 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:13.910747 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e7aaecda2341d08ad6d3a6c919dc74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.911575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e7aaecda2341d08ad6d3a6c919dc74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.912359 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e7aaecda2341d08ad6d3a6c919dc74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.981003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e7aaecda2341d08ad6d3a6c919dc74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.993716 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e7aaecda2341d08ad6d3a6c919dc74'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.007099 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1407/2772] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:13 2022] DELETE /identity/v3/users/05e7aaecda2341d08ad6d3a6c919dc74 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:14.012203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2529b02-51b1-4091-8610-c79abe2e42ec None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.012672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2529b02-51b1-4091-8610-c79abe2e42ec None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.012779 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2529b02-51b1-4091-8610-c79abe2e42ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.032688 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a2529b02-51b1-4091-8610-c79abe2e42ec None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:14.033942 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a2529b02-51b1-4091-8610-c79abe2e42ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:14.094614 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1366/2773] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:14.104429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:14.105881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:14.164687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecff4a-3eca-4627-91f5-491a3651eea8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:14.168412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26dd4a-b38e-46b2-bf3c-50d006b4a69c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:14.169033 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26dd4a-b38e-46b2-bf3c-50d006b4a69c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.169317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26dd4a-b38e-46b2-bf3c-50d006b4a69c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.169593 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26dd4a-b38e-46b2-bf3c-50d006b4a69c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.179060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26dd4a-b38e-46b2-bf3c-50d006b4a69c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:14.180523 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26dd4a-b38e-46b2-bf3c-50d006b4a69c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:14.190469 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1408/2774] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:14.636084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2529b02-51b1-4091-8610-c79abe2e42ec None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:14.637622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a2529b02-51b1-4091-8610-c79abe2e42ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:14.650517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2529b02-51b1-4091-8610-c79abe2e42ec None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:14.655499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:14.656156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.656433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.656704 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] PATH_INFO: `/v3/projects/05e90a7b7bc84c669ec34307db7b59b2` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.657865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e90a7b7bc84c669ec34307db7b59b2)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:14.660949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:14.817510 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e90a7b7bc84c669ec34307db7b59b2', 'request_id': 'req-d4e64a14-1de6-459c-abcc-29353d2950c9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.824007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e90a7b7bc84c669ec34307db7b59b2', 'request_id': 'req-d4e64a14-1de6-459c-abcc-29353d2950c9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.925077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e90a7b7bc84c669ec34307db7b59b2', 'request_id': 'req-d4e64a14-1de6-459c-abcc-29353d2950c9'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.937507 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] The token cache is being invalidate because project 05e90a7b7bc84c669ec34307db7b59b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:14.937795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.938464 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.940048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1367/2775] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:14 2022] DELETE /identity/v3/projects/05e90a7b7bc84c669ec34307db7b59b2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:14.944102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26dd4a-b38e-46b2-bf3c-50d006b4a69c service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:14.955023 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26dd4a-b38e-46b2-bf3c-50d006b4a69c service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.014277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e69b-498d-4e7d-aa2c-cfe1403f0311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.014975 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e69b-498d-4e7d-aa2c-cfe1403f0311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.016250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e69b-498d-4e7d-aa2c-cfe1403f0311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.016250 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e69b-498d-4e7d-aa2c-cfe1403f0311 admin admin] PATH_INFO: `/v3/users/af2fb2051c514996b2e0f9f0f1c6e511` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.016751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49e69b-498d-4e7d-aa2c-cfe1403f0311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2fb2051c514996b2e0f9f0f1c6e511)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.018708 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49e69b-498d-4e7d-aa2c-cfe1403f0311 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.207270 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d49e69b-498d-4e7d-aa2c-cfe1403f0311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2fb2051c514996b2e0f9f0f1c6e511'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.207935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d49e69b-498d-4e7d-aa2c-cfe1403f0311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2fb2051c514996b2e0f9f0f1c6e511'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.208547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d49e69b-498d-4e7d-aa2c-cfe1403f0311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2fb2051c514996b2e0f9f0f1c6e511'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.313676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d49e69b-498d-4e7d-aa2c-cfe1403f0311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2fb2051c514996b2e0f9f0f1c6e511'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.326453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:15.328895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-8d49e69b-498d-4e7d-aa2c-cfe1403f0311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2fb2051c514996b2e0f9f0f1c6e511'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.342005 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1409/2776] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:14 2022] DELETE /identity/v3/users/af2fb2051c514996b2e0f9f0f1c6e511 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:15.806815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.808389 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:15.823792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e64a14-1de6-459c-abcc-29353d2950c9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.986480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.986480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.986480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.986480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] PATH_INFO: `/v3/projects/f3205c10838e4326a3b8dd255f34ebaa` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.987106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3205c10838e4326a3b8dd255f34ebaa)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.987106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.987106 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:16.069154 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3205c10838e4326a3b8dd255f34ebaa', 'request_id': 'req-7e644d77-a411-44cb-af4a-408abbb21207'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.075762 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3205c10838e4326a3b8dd255f34ebaa', 'request_id': 'req-7e644d77-a411-44cb-af4a-408abbb21207'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.142588 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3205c10838e4326a3b8dd255f34ebaa', 'request_id': 'req-7e644d77-a411-44cb-af4a-408abbb21207'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.154323 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] The token cache is being invalidate because project f3205c10838e4326a3b8dd255f34ebaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:16.154611 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.155275 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7e644d77-a411-44cb-af4a-408abbb21207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.156991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1368/2777] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:15 2022] DELETE /identity/v3/projects/f3205c10838e4326a3b8dd255f34ebaa => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:16.162100 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e73b5-b6ad-476a-a4f0-f9388b5f8c1a None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.162638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e73b5-b6ad-476a-a4f0-f9388b5f8c1a None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.162638 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e73b5-b6ad-476a-a4f0-f9388b5f8c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.182667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-5a3e73b5-b6ad-476a-a4f0-f9388b5f8c1a None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:16.183999 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-5a3e73b5-b6ad-476a-a4f0-f9388b5f8c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.244309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1410/2778] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:16.252220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199bd01-9284-40ca-88db-30ddf1e41ba0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.252503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199bd01-9284-40ca-88db-30ddf1e41ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.252784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199bd01-9284-40ca-88db-30ddf1e41ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.273761 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f199bd01-9284-40ca-88db-30ddf1e41ba0 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:16.275057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f199bd01-9284-40ca-88db-30ddf1e41ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.283018 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1369/2779] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:16.287303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e73b5-b6ad-476a-a4f0-f9388b5f8c1a None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.297493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e73b5-b6ad-476a-a4f0-f9388b5f8c1a None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.302615 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adfc23-2805-4ef6-aeac-48986268c58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.303306 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adfc23-2805-4ef6-aeac-48986268c58b admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.303596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adfc23-2805-4ef6-aeac-48986268c58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.303879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adfc23-2805-4ef6-aeac-48986268c58b admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.304582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adfc23-2805-4ef6-aeac-48986268c58b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:16.304895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adfc23-2805-4ef6-aeac-48986268c58b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.307064 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adfc23-2805-4ef6-aeac-48986268c58b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.319298 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1411/2780] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:16.324403 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199bd01-9284-40ca-88db-30ddf1e41ba0 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.334220 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199bd01-9284-40ca-88db-30ddf1e41ba0 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.339539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd6c45-a293-4453-9f06-0ef7170e75e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.340149 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd6c45-a293-4453-9f06-0ef7170e75e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.340432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd6c45-a293-4453-9f06-0ef7170e75e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.340730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd6c45-a293-4453-9f06-0ef7170e75e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.341364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd6c45-a293-4453-9f06-0ef7170e75e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.343306 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd6c45-a293-4453-9f06-0ef7170e75e9 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.453603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1370/2781] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:16 2022] POST /identity/v3/projects => generated 407 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:16.457973 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adfc23-2805-4ef6-aeac-48986268c58b admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.468392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adfc23-2805-4ef6-aeac-48986268c58b admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.526921 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3247e-d402-4aeb-bcfd-9fe725940951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.527694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3247e-d402-4aeb-bcfd-9fe725940951 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.527976 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3247e-d402-4aeb-bcfd-9fe725940951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.528252 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3247e-d402-4aeb-bcfd-9fe725940951 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.528889 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3247e-d402-4aeb-bcfd-9fe725940951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.531238 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3247e-d402-4aeb-bcfd-9fe725940951 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.634375 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1412/2782] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:16 2022] POST /identity/v3/users => generated 304 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:16.636503 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd6c45-a293-4453-9f06-0ef7170e75e9 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.647270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd6c45-a293-4453-9f06-0ef7170e75e9 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.651983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321cd8b-a03a-46a7-b599-402edc6b648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.652599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321cd8b-a03a-46a7-b599-402edc6b648d admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.652881 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321cd8b-a03a-46a7-b599-402edc6b648d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.653158 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321cd8b-a03a-46a7-b599-402edc6b648d admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.653812 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321cd8b-a03a-46a7-b599-402edc6b648d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.655490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321cd8b-a03a-46a7-b599-402edc6b648d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.666597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1371/2783] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:16.670934 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3247e-d402-4aeb-bcfd-9fe725940951 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.681925 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3247e-d402-4aeb-bcfd-9fe725940951 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.686645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc9e9a-5dac-42c3-986d-7b23b10c2fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.687319 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc9e9a-5dac-42c3-986d-7b23b10c2fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.687601 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc9e9a-5dac-42c3-986d-7b23b10c2fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.687873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc9e9a-5dac-42c3-986d-7b23b10c2fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.688521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc9e9a-5dac-42c3-986d-7b23b10c2fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.690121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc9e9a-5dac-42c3-986d-7b23b10c2fe8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.701315 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1413/2784] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:16.709786 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321cd8b-a03a-46a7-b599-402edc6b648d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.720826 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321cd8b-a03a-46a7-b599-402edc6b648d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.726367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f2092-27ec-4ef0-b6b6-afdc9813388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.727102 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f2092-27ec-4ef0-b6b6-afdc9813388a admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.727377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f2092-27ec-4ef0-b6b6-afdc9813388a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.728142 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f2092-27ec-4ef0-b6b6-afdc9813388a admin admin] PATH_INFO: `/v3/projects/7e4f3261b2f84ec6b5e53d68cb0c3de5/users/c6e4ebc680a64b89aca3506a7f45c566/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.744453 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f2092-27ec-4ef0-b6b6-afdc9813388a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4f3261b2f84ec6b5e53d68cb0c3de5, user_id=c6e4ebc680a64b89aca3506a7f45c566, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.747238 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f2092-27ec-4ef0-b6b6-afdc9813388a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.834431 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1372/2785] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:16 2022] PUT /identity/v3/projects/7e4f3261b2f84ec6b5e53d68cb0c3de5/users/c6e4ebc680a64b89aca3506a7f45c566/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:16.846107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80818c-a0f8-48a1-8209-a60a45075d08 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.846322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80818c-a0f8-48a1-8209-a60a45075d08 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.846596 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80818c-a0f8-48a1-8209-a60a45075d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.883661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-1c80818c-a0f8-48a1-8209-a60a45075d08 None None] MFA Rules not processed for user `c6e4ebc680a64b89aca3506a7f45c566`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:16.884922 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1c80818c-a0f8-48a1-8209-a60a45075d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.927881 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:16.953419 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1414/2786] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:16 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:16.957731 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f2092-27ec-4ef0-b6b6-afdc9813388a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.022325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f2092-27ec-4ef0-b6b6-afdc9813388a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.028187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2528-2917-489a-89cc-79d669cf27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.028841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2528-2917-489a-89cc-79d669cf27cf admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.029121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2528-2917-489a-89cc-79d669cf27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.029394 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2528-2917-489a-89cc-79d669cf27cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.030026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f2528-2917-489a-89cc-79d669cf27cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.032067 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f2528-2917-489a-89cc-79d669cf27cf admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.161475 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1373/2787] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:16 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:17.172175 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80818c-a0f8-48a1-8209-a60a45075d08 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.183589 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80818c-a0f8-48a1-8209-a60a45075d08 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.245810 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856ee19-4eaf-4138-8154-d4f0825000c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.246427 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ee19-4eaf-4138-8154-d4f0825000c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.246745 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ee19-4eaf-4138-8154-d4f0825000c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.247022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856ee19-4eaf-4138-8154-d4f0825000c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.247701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856ee19-4eaf-4138-8154-d4f0825000c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.249668 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856ee19-4eaf-4138-8154-d4f0825000c8 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.333041 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1415/2788] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/users => generated 309 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:17.338359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2528-2917-489a-89cc-79d669cf27cf admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.349534 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2528-2917-489a-89cc-79d669cf27cf admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.354307 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0e3cc-f8ed-48bc-8709-7f035e2d315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.354934 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0e3cc-f8ed-48bc-8709-7f035e2d315f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.355258 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0e3cc-f8ed-48bc-8709-7f035e2d315f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.355541 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0e3cc-f8ed-48bc-8709-7f035e2d315f admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.356219 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0e3cc-f8ed-48bc-8709-7f035e2d315f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.357874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0e3cc-f8ed-48bc-8709-7f035e2d315f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.371977 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1374/2789] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:17.373325 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856ee19-4eaf-4138-8154-d4f0825000c8 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.383675 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856ee19-4eaf-4138-8154-d4f0825000c8 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.388770 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406c297-d2d2-4809-93a7-0b029a1d25f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.389919 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c297-d2d2-4809-93a7-0b029a1d25f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.389919 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c297-d2d2-4809-93a7-0b029a1d25f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.390237 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c297-d2d2-4809-93a7-0b029a1d25f4 admin admin] PATH_INFO: `/v3/projects/0754d7b4c5ca4ef2bab2566c33f9e4b0/users/483922b158494015ad0f7c51867fc15f/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.407780 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406c297-d2d2-4809-93a7-0b029a1d25f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0754d7b4c5ca4ef2bab2566c33f9e4b0, user_id=483922b158494015ad0f7c51867fc15f, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.410476 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406c297-d2d2-4809-93a7-0b029a1d25f4 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.560706 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1416/2790] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:17 2022] PUT /identity/v3/projects/0754d7b4c5ca4ef2bab2566c33f9e4b0/users/483922b158494015ad0f7c51867fc15f/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:17.565065 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0e3cc-f8ed-48bc-8709-7f035e2d315f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.575635 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0e3cc-f8ed-48bc-8709-7f035e2d315f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.588198 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:17.632234 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ae69-a91e-4fa3-9ba4-3315cdcbec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.632849 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ae69-a91e-4fa3-9ba4-3315cdcbec44 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.633130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ae69-a91e-4fa3-9ba4-3315cdcbec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.633406 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ae69-a91e-4fa3-9ba4-3315cdcbec44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.634055 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ae69-a91e-4fa3-9ba4-3315cdcbec44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.635701 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ae69-a91e-4fa3-9ba4-3315cdcbec44 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.649204 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1375/2791] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:17.651736 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406c297-d2d2-4809-93a7-0b029a1d25f4 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.669147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406c297-d2d2-4809-93a7-0b029a1d25f4 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.676838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b70a2-155a-4a85-a667-f7a149057f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.691953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b70a2-155a-4a85-a667-f7a149057f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.691953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b70a2-155a-4a85-a667-f7a149057f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.691953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b70a2-155a-4a85-a667-f7a149057f11 admin admin] PATH_INFO: `/v3/projects/0754d7b4c5ca4ef2bab2566c33f9e4b0/users/483922b158494015ad0f7c51867fc15f/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.691953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b70a2-155a-4a85-a667-f7a149057f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0754d7b4c5ca4ef2bab2566c33f9e4b0, user_id=483922b158494015ad0f7c51867fc15f, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.691953 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b70a2-155a-4a85-a667-f7a149057f11 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.697267 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1417/2792] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:17 2022] PUT /identity/v3/projects/0754d7b4c5ca4ef2bab2566c33f9e4b0/users/483922b158494015ad0f7c51867fc15f/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:17.710310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861c22-757c-42f4-8462-fa0602ddec4a None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.710310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861c22-757c-42f4-8462-fa0602ddec4a None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.710310 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861c22-757c-42f4-8462-fa0602ddec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.740336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-59861c22-757c-42f4-8462-fa0602ddec4a None None] MFA Rules not processed for user `483922b158494015ad0f7c51867fc15f`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:17.741567 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-59861c22-757c-42f4-8462-fa0602ddec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:17.818704 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1376/2793] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:17.830424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b70a2-155a-4a85-a667-f7a149057f11 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.832225 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-bc2b70a2-155a-4a85-a667-f7a149057f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:17.892111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b70a2-155a-4a85-a667-f7a149057f11 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.895844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffb1a9-cbe6-42a9-baf1-f9f7770e38bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.896435 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffb1a9-cbe6-42a9-baf1-f9f7770e38bb service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.896717 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffb1a9-cbe6-42a9-baf1-f9f7770e38bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.896995 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffb1a9-cbe6-42a9-baf1-f9f7770e38bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.906649 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffb1a9-cbe6-42a9-baf1-f9f7770e38bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.908257 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffb1a9-cbe6-42a9-baf1-f9f7770e38bb service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.918599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1418/2794] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:17 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:18.348000 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59861c22-757c-42f4-8462-fa0602ddec4a None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.358152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59861c22-757c-42f4-8462-fa0602ddec4a None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.361909 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8dc267-9529-4c50-9731-ad912ca9b8a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.362915 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dc267-9529-4c50-9731-ad912ca9b8a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.363236 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dc267-9529-4c50-9731-ad912ca9b8a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.363517 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dc267-9529-4c50-9731-ad912ca9b8a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.422713 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8dc267-9529-4c50-9731-ad912ca9b8a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.424259 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8dc267-9529-4c50-9731-ad912ca9b8a6 service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.434242 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1377/2795] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:18 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:25.557275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffb1a9-cbe6-42a9-baf1-f9f7770e38bb service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:25.605935 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:25.631762 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffb1a9-cbe6-42a9-baf1-f9f7770e38bb service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:25.637331 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:25.640943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:25.640943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:25.640943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] PATH_INFO: `/v3/users/c6e4ebc680a64b89aca3506a7f45c566` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:25.640943 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e4ebc680a64b89aca3506a7f45c566)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:25.641956 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:25.937293 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e4ebc680a64b89aca3506a7f45c566'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.938102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e4ebc680a64b89aca3506a7f45c566'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.938852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e4ebc680a64b89aca3506a7f45c566'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.033768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e4ebc680a64b89aca3506a7f45c566'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.049206 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e4ebc680a64b89aca3506a7f45c566'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.061369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1419/2796] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:25 2022] DELETE /identity/v3/users/c6e4ebc680a64b89aca3506a7f45c566 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:26.066062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7380b2-8fd4-4f6f-af4f-5f345e6f812c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:26.066630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7380b2-8fd4-4f6f-af4f-5f345e6f812c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:26.066630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7380b2-8fd4-4f6f-af4f-5f345e6f812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:26.085793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-9c7380b2-8fd4-4f6f-af4f-5f345e6f812c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:26.087005 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9c7380b2-8fd4-4f6f-af4f-5f345e6f812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:26.120873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:26.164112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1378/2797] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:26.176600 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:26.178269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:26.268689 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe58b8-eb3b-4c64-b763-7c188abe1fec admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:26.272355 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d096301-f895-406c-8638-148455eb18f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:26.272965 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096301-f895-406c-8638-148455eb18f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:26.274632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096301-f895-406c-8638-148455eb18f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:26.274632 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096301-f895-406c-8638-148455eb18f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:26.283837 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d096301-f895-406c-8638-148455eb18f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:26.285328 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d096301-f895-406c-8638-148455eb18f2 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:26.297070 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1420/2798] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:26.771974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7380b2-8fd4-4f6f-af4f-5f345e6f812c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:26.773470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9c7380b2-8fd4-4f6f-af4f-5f345e6f812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:26.786720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7380b2-8fd4-4f6f-af4f-5f345e6f812c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:26.791672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:26.792317 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:26.792605 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:26.792933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] PATH_INFO: `/v3/projects/7e4f3261b2f84ec6b5e53d68cb0c3de5` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:26.794073 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4f3261b2f84ec6b5e53d68cb0c3de5)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:26.796099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:26.944664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4f3261b2f84ec6b5e53d68cb0c3de5', 'request_id': 'req-9a3afcaa-83f6-403e-a744-3002ec4199c3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.953934 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4f3261b2f84ec6b5e53d68cb0c3de5', 'request_id': 'req-9a3afcaa-83f6-403e-a744-3002ec4199c3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.050524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4f3261b2f84ec6b5e53d68cb0c3de5', 'request_id': 'req-9a3afcaa-83f6-403e-a744-3002ec4199c3'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.063893 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] The token cache is being invalidate because project 7e4f3261b2f84ec6b5e53d68cb0c3de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:27.064191 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.065006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.066748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1379/2799] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:26 2022] DELETE /identity/v3/projects/7e4f3261b2f84ec6b5e53d68cb0c3de5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:27.071417 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d096301-f895-406c-8638-148455eb18f2 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:27.082305 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d096301-f895-406c-8638-148455eb18f2 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:27.116746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:27.140793 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5ecb5-1bba-4095-ad14-f1d21926c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:27.141545 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5ecb5-1bba-4095-ad14-f1d21926c47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:27.141879 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5ecb5-1bba-4095-ad14-f1d21926c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:27.142196 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5ecb5-1bba-4095-ad14-f1d21926c47a admin admin] PATH_INFO: `/v3/users/483922b158494015ad0f7c51867fc15f` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:27.143712 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5ecb5-1bba-4095-ad14-f1d21926c47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=483922b158494015ad0f7c51867fc15f)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:27.146081 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5ecb5-1bba-4095-ad14-f1d21926c47a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:27.368101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bec5ecb5-1bba-4095-ad14-f1d21926c47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483922b158494015ad0f7c51867fc15f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.369336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bec5ecb5-1bba-4095-ad14-f1d21926c47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483922b158494015ad0f7c51867fc15f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.369957 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bec5ecb5-1bba-4095-ad14-f1d21926c47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483922b158494015ad0f7c51867fc15f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.473030 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bec5ecb5-1bba-4095-ad14-f1d21926c47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483922b158494015ad0f7c51867fc15f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.486424 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-bec5ecb5-1bba-4095-ad14-f1d21926c47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483922b158494015ad0f7c51867fc15f'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.499282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1421/2800] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:27 2022] DELETE /identity/v3/users/483922b158494015ad0f7c51867fc15f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:27.960279 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:27.961769 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:27.980043 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3afcaa-83f6-403e-a744-3002ec4199c3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.039316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.039884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.040167 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.040985 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] PATH_INFO: `/v3/projects/0754d7b4c5ca4ef2bab2566c33f9e4b0` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.042119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0754d7b4c5ca4ef2bab2566c33f9e4b0)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.044086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:28.440210 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0754d7b4c5ca4ef2bab2566c33f9e4b0', 'request_id': 'req-2575ba4a-99c8-47ce-8a27-efa62ab882a7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:28.445574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0754d7b4c5ca4ef2bab2566c33f9e4b0', 'request_id': 'req-2575ba4a-99c8-47ce-8a27-efa62ab882a7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:28.449941 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:28.535747 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0754d7b4c5ca4ef2bab2566c33f9e4b0', 'request_id': 'req-2575ba4a-99c8-47ce-8a27-efa62ab882a7'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:28.548146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] The token cache is being invalidate because project 0754d7b4c5ca4ef2bab2566c33f9e4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:28.548440 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:28.549077 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-2575ba4a-99c8-47ce-8a27-efa62ab882a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:28.550666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1380/2801] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:27 2022] DELETE /identity/v3/projects/0754d7b4c5ca4ef2bab2566c33f9e4b0 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:28.555591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaf0e8-cbc1-49a5-b382-9b2beb50951c None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.556095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaf0e8-cbc1-49a5-b382-9b2beb50951c None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.556197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaf0e8-cbc1-49a5-b382-9b2beb50951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.577192 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-2adaf0e8-cbc1-49a5-b382-9b2beb50951c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:28.578411 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-2adaf0e8-cbc1-49a5-b382-9b2beb50951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:28.640515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1422/2802] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:28.648792 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253573d3-c8c1-4d39-9071-0e6aa94fba4c None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.649080 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253573d3-c8c1-4d39-9071-0e6aa94fba4c None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.649358 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253573d3-c8c1-4d39-9071-0e6aa94fba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.670301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-253573d3-c8c1-4d39-9071-0e6aa94fba4c None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:28.671660 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-253573d3-c8c1-4d39-9071-0e6aa94fba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:28.682739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1381/2803] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:28.689752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaf0e8-cbc1-49a5-b382-9b2beb50951c None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:28.701405 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaf0e8-cbc1-49a5-b382-9b2beb50951c None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.706245 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5e2e-9efc-4305-8b33-e239ace732b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.706855 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5e2e-9efc-4305-8b33-e239ace732b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.707168 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5e2e-9efc-4305-8b33-e239ace732b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.707443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5e2e-9efc-4305-8b33-e239ace732b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.708096 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee5e2e-9efc-4305-8b33-e239ace732b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:28.708400 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee5e2e-9efc-4305-8b33-e239ace732b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.710111 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee5e2e-9efc-4305-8b33-e239ace732b1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:28.725153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1423/2804] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:28.734172 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253573d3-c8c1-4d39-9071-0e6aa94fba4c None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:28.748344 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253573d3-c8c1-4d39-9071-0e6aa94fba4c None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.753391 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113abe3-3ff7-4c9c-bdcb-3688234b540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.753995 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113abe3-3ff7-4c9c-bdcb-3688234b540d admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.754277 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113abe3-3ff7-4c9c-bdcb-3688234b540d admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.754548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113abe3-3ff7-4c9c-bdcb-3688234b540d admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.755207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113abe3-3ff7-4c9c-bdcb-3688234b540d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.757120 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113abe3-3ff7-4c9c-bdcb-3688234b540d admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:28.888136 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1382/2805] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:28 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:28.897342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5e2e-9efc-4305-8b33-e239ace732b1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:28.908173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5e2e-9efc-4305-8b33-e239ace732b1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.954312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:28.970800 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78a8c8-5d06-49a3-b2e0-2616ad39c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.971645 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78a8c8-5d06-49a3-b2e0-2616ad39c362 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.972026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78a8c8-5d06-49a3-b2e0-2616ad39c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.972343 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78a8c8-5d06-49a3-b2e0-2616ad39c362 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.973158 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78a8c8-5d06-49a3-b2e0-2616ad39c362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.975599 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78a8c8-5d06-49a3-b2e0-2616ad39c362 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.056277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1424/2806] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:28 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:29.060670 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113abe3-3ff7-4c9c-bdcb-3688234b540d admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.072133 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113abe3-3ff7-4c9c-bdcb-3688234b540d admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.077417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9115307-642f-4d02-9997-3b1c0c6d3b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.078040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115307-642f-4d02-9997-3b1c0c6d3b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.078455 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115307-642f-4d02-9997-3b1c0c6d3b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.078640 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115307-642f-4d02-9997-3b1c0c6d3b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.079262 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9115307-642f-4d02-9997-3b1c0c6d3b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.080997 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9115307-642f-4d02-9997-3b1c0c6d3b68 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.092477 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1383/2807] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:29.104657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78a8c8-5d06-49a3-b2e0-2616ad39c362 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.116512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78a8c8-5d06-49a3-b2e0-2616ad39c362 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.122586 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51016683-2d3c-405e-b451-94dbe2642afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.123451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51016683-2d3c-405e-b451-94dbe2642afe admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.123737 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51016683-2d3c-405e-b451-94dbe2642afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.124018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51016683-2d3c-405e-b451-94dbe2642afe admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.124684 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51016683-2d3c-405e-b451-94dbe2642afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.126339 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51016683-2d3c-405e-b451-94dbe2642afe admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.138816 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1425/2808] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:29.143329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9115307-642f-4d02-9997-3b1c0c6d3b68 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.154508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9115307-642f-4d02-9997-3b1c0c6d3b68 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.159417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdc9a5-2d65-453c-a00f-8025e4889b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.160070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc9a5-2d65-453c-a00f-8025e4889b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.160353 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc9a5-2d65-453c-a00f-8025e4889b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.160630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc9a5-2d65-453c-a00f-8025e4889b1a admin admin] PATH_INFO: `/v3/projects/0b3a486cfee44902935d0b112a9ca89e/users/4f806e1a859f4ebc9dabe5f8636804b5/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.176359 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdc9a5-2d65-453c-a00f-8025e4889b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3a486cfee44902935d0b112a9ca89e, user_id=4f806e1a859f4ebc9dabe5f8636804b5, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.179591 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdc9a5-2d65-453c-a00f-8025e4889b1a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.253082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1384/2809] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:29 2022] PUT /identity/v3/projects/0b3a486cfee44902935d0b112a9ca89e/users/4f806e1a859f4ebc9dabe5f8636804b5/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:29.265046 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c8d2-b382-45f7-8833-09e854b69d0f None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.265334 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c8d2-b382-45f7-8833-09e854b69d0f None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.265609 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c8d2-b382-45f7-8833-09e854b69d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.295815 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-17b7c8d2-b382-45f7-8833-09e854b69d0f None None] MFA Rules not processed for user `4f806e1a859f4ebc9dabe5f8636804b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:29.297040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-17b7c8d2-b382-45f7-8833-09e854b69d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:29.369899 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1426/2810] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:29.374696 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdc9a5-2d65-453c-a00f-8025e4889b1a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.439726 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdc9a5-2d65-453c-a00f-8025e4889b1a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.444422 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f43de-f31f-4825-8a77-8d947f3ca716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.445023 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f43de-f31f-4825-8a77-8d947f3ca716 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.445297 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f43de-f31f-4825-8a77-8d947f3ca716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.445571 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f43de-f31f-4825-8a77-8d947f3ca716 admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.446194 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f43de-f31f-4825-8a77-8d947f3ca716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.448930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f43de-f31f-4825-8a77-8d947f3ca716 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.544040 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1385/2811] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:29 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:29.547919 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7c8d2-b382-45f7-8833-09e854b69d0f None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.560906 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7c8d2-b382-45f7-8833-09e854b69d0f None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.620384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c04ef6-cf4e-4cca-86dc-f3b7f1739bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.621003 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04ef6-cf4e-4cca-86dc-f3b7f1739bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.621287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04ef6-cf4e-4cca-86dc-f3b7f1739bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.621565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04ef6-cf4e-4cca-86dc-f3b7f1739bfa admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.622197 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c04ef6-cf4e-4cca-86dc-f3b7f1739bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.624158 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c04ef6-cf4e-4cca-86dc-f3b7f1739bfa admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.748433 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1427/2812] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:29 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:29.752629 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f43de-f31f-4825-8a77-8d947f3ca716 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.765793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f43de-f31f-4825-8a77-8d947f3ca716 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.770584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5482762-a6cf-4ebd-a22c-b44d9583c157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.774817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5482762-a6cf-4ebd-a22c-b44d9583c157 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.774817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5482762-a6cf-4ebd-a22c-b44d9583c157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.774817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5482762-a6cf-4ebd-a22c-b44d9583c157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.774817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5482762-a6cf-4ebd-a22c-b44d9583c157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.774817 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5482762-a6cf-4ebd-a22c-b44d9583c157 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.787668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1386/2813] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:29.792121 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c04ef6-cf4e-4cca-86dc-f3b7f1739bfa admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.803786 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c04ef6-cf4e-4cca-86dc-f3b7f1739bfa admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.809188 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106bd04-1e42-4aaa-a288-23d435bf1077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.814997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106bd04-1e42-4aaa-a288-23d435bf1077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.814997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106bd04-1e42-4aaa-a288-23d435bf1077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.814997 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106bd04-1e42-4aaa-a288-23d435bf1077 admin admin] PATH_INFO: `/v3/projects/2bb2e65e874b4ef9b7a08164b6c3ea13/users/011345da81554c229044e85c7a2ffa8d/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.826386 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106bd04-1e42-4aaa-a288-23d435bf1077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb2e65e874b4ef9b7a08164b6c3ea13, user_id=011345da81554c229044e85c7a2ffa8d, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.829147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106bd04-1e42-4aaa-a288-23d435bf1077 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.906125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1428/2814] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:29 2022] PUT /identity/v3/projects/2bb2e65e874b4ef9b7a08164b6c3ea13/users/011345da81554c229044e85c7a2ffa8d/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:29.910245 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5482762-a6cf-4ebd-a22c-b44d9583c157 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.920890 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5482762-a6cf-4ebd-a22c-b44d9583c157 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.977962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e059f4a-cd53-4552-8e93-5db568cc7874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.978630 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e059f4a-cd53-4552-8e93-5db568cc7874 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.979435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e059f4a-cd53-4552-8e93-5db568cc7874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.979705 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e059f4a-cd53-4552-8e93-5db568cc7874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.980349 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e059f4a-cd53-4552-8e93-5db568cc7874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.981951 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e059f4a-cd53-4552-8e93-5db568cc7874 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.984117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:29.992305 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1387/2815] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:29.996709 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106bd04-1e42-4aaa-a288-23d435bf1077 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:30.006670 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106bd04-1e42-4aaa-a288-23d435bf1077 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:30.012138 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e150acd-2e97-4f88-96a5-cfa81b9851cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:30.012827 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e150acd-2e97-4f88-96a5-cfa81b9851cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:30.013107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e150acd-2e97-4f88-96a5-cfa81b9851cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:30.013388 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e150acd-2e97-4f88-96a5-cfa81b9851cf admin admin] PATH_INFO: `/v3/projects/2bb2e65e874b4ef9b7a08164b6c3ea13/users/011345da81554c229044e85c7a2ffa8d/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:30.015407 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e150acd-2e97-4f88-96a5-cfa81b9851cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb2e65e874b4ef9b7a08164b6c3ea13, user_id=011345da81554c229044e85c7a2ffa8d, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:30.018223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e150acd-2e97-4f88-96a5-cfa81b9851cf admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:30.030080 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1429/2816] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:29 2022] PUT /identity/v3/projects/2bb2e65e874b4ef9b7a08164b6c3ea13/users/011345da81554c229044e85c7a2ffa8d/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:30.040568 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c7d1-2e14-419a-939c-c43c5c8f4766 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:30.040873 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c7d1-2e14-419a-939c-c43c5c8f4766 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:30.041157 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c7d1-2e14-419a-939c-c43c5c8f4766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:30.072921 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-7ff9c7d1-2e14-419a-939c-c43c5c8f4766 None None] MFA Rules not processed for user `011345da81554c229044e85c7a2ffa8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:30.074071 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7ff9c7d1-2e14-419a-939c-c43c5c8f4766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:30.142742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1388/2817] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:30.154820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e150acd-2e97-4f88-96a5-cfa81b9851cf admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:30.156594 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-1e150acd-2e97-4f88-96a5-cfa81b9851cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:30.161582 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:30.244314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e150acd-2e97-4f88-96a5-cfa81b9851cf admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:30.248108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42430d-75c2-47b0-97b2-5c6290d58eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:30.248751 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42430d-75c2-47b0-97b2-5c6290d58eda service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:30.249029 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42430d-75c2-47b0-97b2-5c6290d58eda service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:30.249304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42430d-75c2-47b0-97b2-5c6290d58eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:30.317126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42430d-75c2-47b0-97b2-5c6290d58eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:30.318597 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42430d-75c2-47b0-97b2-5c6290d58eda service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:30.329412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1430/2818] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:34.142134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9c7d1-2e14-419a-939c-c43c5c8f4766 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.143603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7ff9c7d1-2e14-419a-939c-c43c5c8f4766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:34.213367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9c7d1-2e14-419a-939c-c43c5c8f4766 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.218336 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.218987 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.219316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.219590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] PATH_INFO: `/v3/users/1a776c4ad92d43f99daee7b658aaae4c` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.220758 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a776c4ad92d43f99daee7b658aaae4c)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.222753 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.416730 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a776c4ad92d43f99daee7b658aaae4c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:34.518865 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a776c4ad92d43f99daee7b658aaae4c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:34.527895 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a776c4ad92d43f99daee7b658aaae4c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:34.534487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a776c4ad92d43f99daee7b658aaae4c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:34.542793 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a776c4ad92d43f99daee7b658aaae4c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:34.549156 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1389/2819] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:34 2022] DELETE /identity/v3/users/1a776c4ad92d43f99daee7b658aaae4c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:34.553777 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7bfc5-d2f4-467c-8ec2-e5adfaa61f93 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.554275 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7bfc5-d2f4-467c-8ec2-e5adfaa61f93 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.554372 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7bfc5-d2f4-467c-8ec2-e5adfaa61f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.576584 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-6ff7bfc5-d2f4-467c-8ec2-e5adfaa61f93 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:34.577812 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ff7bfc5-d2f4-467c-8ec2-e5adfaa61f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:34.641690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1431/2820] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:34.652481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.654171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:34.659388 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:34.712928 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342d8d9-475d-4a9e-9f3b-6d2a1039ca61 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.717281 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f714-0729-4acd-b505-7bf513521bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.717901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f714-0729-4acd-b505-7bf513521bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.718192 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f714-0729-4acd-b505-7bf513521bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.718467 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f714-0729-4acd-b505-7bf513521bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.728576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4f714-0729-4acd-b505-7bf513521bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.730606 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4f714-0729-4acd-b505-7bf513521bd9 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.741821 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1390/2821] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:35.343705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7bfc5-d2f4-467c-8ec2-e5adfaa61f93 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.345240 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-6ff7bfc5-d2f4-467c-8ec2-e5adfaa61f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:35.358746 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7bfc5-d2f4-467c-8ec2-e5adfaa61f93 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.363522 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.365002 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.365299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.365920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] PATH_INFO: `/v3/projects/a52d8b4f0a9f40229108a34062ac991d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.367259 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a52d8b4f0a9f40229108a34062ac991d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.369108 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:35.579312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:35.589207 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a52d8b4f0a9f40229108a34062ac991d', 'request_id': 'req-7e569c7b-3835-44fe-baa6-e85ab6e27962'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:35.695486 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a52d8b4f0a9f40229108a34062ac991d', 'request_id': 'req-7e569c7b-3835-44fe-baa6-e85ab6e27962'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:35.702336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a52d8b4f0a9f40229108a34062ac991d', 'request_id': 'req-7e569c7b-3835-44fe-baa6-e85ab6e27962'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:35.713324 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] The token cache is being invalidate because project a52d8b4f0a9f40229108a34062ac991d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:35.713612 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:35.714236 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-7e569c7b-3835-44fe-baa6-e85ab6e27962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:35.715758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1432/2822] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:35 2022] DELETE /identity/v3/projects/a52d8b4f0a9f40229108a34062ac991d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:35.720968 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700c538-3939-483a-9a1d-4230e7a226c6 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.721480 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700c538-3939-483a-9a1d-4230e7a226c6 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.721603 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700c538-3939-483a-9a1d-4230e7a226c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.740990 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-a700c538-3939-483a-9a1d-4230e7a226c6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:35.742196 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-a700c538-3939-483a-9a1d-4230e7a226c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:35.802520 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1391/2823] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:35.811307 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30532-d1dd-410f-a4c3-9d1379a52eb4 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.811603 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30532-d1dd-410f-a4c3-9d1379a52eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.811891 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30532-d1dd-410f-a4c3-9d1379a52eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.832969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f2d30532-d1dd-410f-a4c3-9d1379a52eb4 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:35.834200 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f2d30532-d1dd-410f-a4c3-9d1379a52eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:35.847483 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1433/2824] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:35.852061 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700c538-3939-483a-9a1d-4230e7a226c6 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.864278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700c538-3939-483a-9a1d-4230e7a226c6 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.868105 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7fd1c-66d5-44fe-b5ce-77359f271bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.868810 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7fd1c-66d5-44fe-b5ce-77359f271bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.869175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7fd1c-66d5-44fe-b5ce-77359f271bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.869490 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7fd1c-66d5-44fe-b5ce-77359f271bb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.871069 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7fd1c-66d5-44fe-b5ce-77359f271bb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:35.874168 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7fd1c-66d5-44fe-b5ce-77359f271bb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.875953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7fd1c-66d5-44fe-b5ce-77359f271bb7 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:35.896432 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1392/2825] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:35.899382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d30532-d1dd-410f-a4c3-9d1379a52eb4 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.909765 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d30532-d1dd-410f-a4c3-9d1379a52eb4 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.915173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df702ee-5d80-4347-b8d2-e84db0f6833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.915801 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df702ee-5d80-4347-b8d2-e84db0f6833f admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.916088 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df702ee-5d80-4347-b8d2-e84db0f6833f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.916376 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df702ee-5d80-4347-b8d2-e84db0f6833f admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.917106 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df702ee-5d80-4347-b8d2-e84db0f6833f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.919161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df702ee-5d80-4347-b8d2-e84db0f6833f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:35.947276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7fd1c-66d5-44fe-b5ce-77359f271bb7 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.950506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f7c7fd1c-66d5-44fe-b5ce-77359f271bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:36.028195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7fd1c-66d5-44fe-b5ce-77359f271bb7 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:36.032169 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24af2f-9317-4f47-a399-0c2eac1b357d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:36.032815 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24af2f-9317-4f47-a399-0c2eac1b357d service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:36.033096 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24af2f-9317-4f47-a399-0c2eac1b357d service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:36.033377 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24af2f-9317-4f47-a399-0c2eac1b357d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:36.035320 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8d24af2f-9317-4f47-a399-0c2eac1b357d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:36.053859 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1434/2826] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:35 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:36.054829 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df702ee-5d80-4347-b8d2-e84db0f6833f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:36.088253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=100 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:36.106316 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24af2f-9317-4f47-a399-0c2eac1b357d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:36.107729 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24af2f-9317-4f47-a399-0c2eac1b357d service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:36.117910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1393/2827] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:36.140353 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df702ee-5d80-4347-b8d2-e84db0f6833f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:36.145101 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be97cbc-668c-4c87-bf1f-64373e94a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:36.145710 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be97cbc-668c-4c87-bf1f-64373e94a310 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:36.145990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be97cbc-668c-4c87-bf1f-64373e94a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:36.146294 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be97cbc-668c-4c87-bf1f-64373e94a310 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:36.147484 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be97cbc-668c-4c87-bf1f-64373e94a310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:36.152301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be97cbc-668c-4c87-bf1f-64373e94a310 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:36.268170 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1435/2828] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:36 2022] POST /identity/v3/users => generated 296 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:56:36.272535 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24af2f-9317-4f47-a399-0c2eac1b357d service cinder] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:36.283312 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24af2f-9317-4f47-a399-0c2eac1b357d service cinder] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:36.288034 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dc9f2-c374-4401-9a49-7ff6b6d2042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:36.288637 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc9f2-c374-4401-9a49-7ff6b6d2042a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:36.288922 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc9f2-c374-4401-9a49-7ff6b6d2042a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:36.289208 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc9f2-c374-4401-9a49-7ff6b6d2042a admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:36.289879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dc9f2-c374-4401-9a49-7ff6b6d2042a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:36.291533 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dc9f2-c374-4401-9a49-7ff6b6d2042a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:36.302574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1394/2829] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:36.306732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be97cbc-668c-4c87-bf1f-64373e94a310 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:36.317403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be97cbc-668c-4c87-bf1f-64373e94a310 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:36.322202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d326a-dc7b-4754-a1ff-c83fd65e62af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:36.322797 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d326a-dc7b-4754-a1ff-c83fd65e62af admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:36.323109 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d326a-dc7b-4754-a1ff-c83fd65e62af admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:36.323389 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d326a-dc7b-4754-a1ff-c83fd65e62af admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:36.324036 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d326a-dc7b-4754-a1ff-c83fd65e62af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:36.325627 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d326a-dc7b-4754-a1ff-c83fd65e62af admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:36.335929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1436/2830] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:36.340700 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dc9f2-c374-4401-9a49-7ff6b6d2042a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:36.350894 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dc9f2-c374-4401-9a49-7ff6b6d2042a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:36.356091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62448406-0950-4b84-96b3-4abda4c0331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:36.356795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448406-0950-4b84-96b3-4abda4c0331b admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:36.357013 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448406-0950-4b84-96b3-4abda4c0331b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:36.357285 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448406-0950-4b84-96b3-4abda4c0331b admin admin] PATH_INFO: `/v3/projects/bedccccf09a34c848a2aaa1f55186fad/users/6285e8cdfe344b6398cfac797b8cb899/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:36.373086 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62448406-0950-4b84-96b3-4abda4c0331b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bedccccf09a34c848a2aaa1f55186fad, user_id=6285e8cdfe344b6398cfac797b8cb899, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:36.375943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62448406-0950-4b84-96b3-4abda4c0331b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:36.552946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1395/2831] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:36 2022] PUT /identity/v3/projects/bedccccf09a34c848a2aaa1f55186fad/users/6285e8cdfe344b6398cfac797b8cb899/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:36.619846 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce249e-c37c-4aa6-9438-e1da2d576499 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:36.620393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce249e-c37c-4aa6-9438-e1da2d576499 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:36.620393 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce249e-c37c-4aa6-9438-e1da2d576499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:36.648854 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-19ce249e-c37c-4aa6-9438-e1da2d576499 None None] MFA Rules not processed for user `6285e8cdfe344b6398cfac797b8cb899`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:36.650014 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-19ce249e-c37c-4aa6-9438-e1da2d576499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:36.719094 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1437/2832] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:36.730869 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62448406-0950-4b84-96b3-4abda4c0331b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:36.732618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-62448406-0950-4b84-96b3-4abda4c0331b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:36.790052 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62448406-0950-4b84-96b3-4abda4c0331b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:36.795338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25098ad0-157e-4cbe-96f6-ff1bee61fceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:36.795338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098ad0-157e-4cbe-96f6-ff1bee61fceb service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:36.795338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098ad0-157e-4cbe-96f6-ff1bee61fceb service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:36.795338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098ad0-157e-4cbe-96f6-ff1bee61fceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:36.803884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25098ad0-157e-4cbe-96f6-ff1bee61fceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:36.805331 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25098ad0-157e-4cbe-96f6-ff1bee61fceb service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:36.814360 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1396/2833] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:42.329049 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce249e-c37c-4aa6-9438-e1da2d576499 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:42.330492 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-19ce249e-c37c-4aa6-9438-e1da2d576499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:42.335674 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:42.396480 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce249e-c37c-4aa6-9438-e1da2d576499 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:42.401314 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:42.402549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:42.402549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:42.402549 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] PATH_INFO: `/v3/users/4f806e1a859f4ebc9dabe5f8636804b5` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:42.403787 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f806e1a859f4ebc9dabe5f8636804b5)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:42.406040 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:42.572688 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f806e1a859f4ebc9dabe5f8636804b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:42.573336 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f806e1a859f4ebc9dabe5f8636804b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:42.573941 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f806e1a859f4ebc9dabe5f8636804b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:42.643950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f806e1a859f4ebc9dabe5f8636804b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:42.656503 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f806e1a859f4ebc9dabe5f8636804b5'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:42.668958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1438/2834] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:42 2022] DELETE /identity/v3/users/4f806e1a859f4ebc9dabe5f8636804b5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:42.673622 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd4b97-5315-47bf-9249-e8b0384dc76d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:42.676187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd4b97-5315-47bf-9249-e8b0384dc76d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:42.676187 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd4b97-5315-47bf-9249-e8b0384dc76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:42.693975 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-ccdd4b97-5315-47bf-9249-e8b0384dc76d None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:42.695207 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ccdd4b97-5315-47bf-9249-e8b0384dc76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:42.754101 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1397/2835] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:42.763884 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:42.765299 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:42.824055 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ca98b-cf77-480e-b62a-d7a2c5a06264 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:42.827961 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e83e-5d7a-4dad-a086-b320e9e4aa5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:42.828587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e83e-5d7a-4dad-a086-b320e9e4aa5b service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:42.828867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e83e-5d7a-4dad-a086-b320e9e4aa5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:42.829143 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e83e-5d7a-4dad-a086-b320e9e4aa5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:42.840446 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8e83e-5d7a-4dad-a086-b320e9e4aa5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:42.842022 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8e83e-5d7a-4dad-a086-b320e9e4aa5b service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:42.852481 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1439/2836] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:43.258343 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd4b97-5315-47bf-9249-e8b0384dc76d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:43.260854 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ccdd4b97-5315-47bf-9249-e8b0384dc76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:43.273931 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd4b97-5315-47bf-9249-e8b0384dc76d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:43.286244 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:43.286897 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:43.287267 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:43.287780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] PATH_INFO: `/v3/projects/0b3a486cfee44902935d0b112a9ca89e` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:43.288984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3a486cfee44902935d0b112a9ca89e)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:43.290954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:43.450399 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:43.453574 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3a486cfee44902935d0b112a9ca89e', 'request_id': 'req-b9a35a5c-aa8e-437b-a47b-f06576673a8e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:43.459095 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3a486cfee44902935d0b112a9ca89e', 'request_id': 'req-b9a35a5c-aa8e-437b-a47b-f06576673a8e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:43.530143 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3a486cfee44902935d0b112a9ca89e', 'request_id': 'req-b9a35a5c-aa8e-437b-a47b-f06576673a8e'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:43.542477 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] The token cache is being invalidate because project 0b3a486cfee44902935d0b112a9ca89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:43.542771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:43.544008 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:43.545688 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1398/2837] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:43 2022] DELETE /identity/v3/projects/0b3a486cfee44902935d0b112a9ca89e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:43.553563 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e83e-5d7a-4dad-a086-b320e9e4aa5b service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:43.564515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e83e-5d7a-4dad-a086-b320e9e4aa5b service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:43.587104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:43.628885 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f849f6-a4b1-4d0b-ba81-ae4a568daca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:43.629535 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f849f6-a4b1-4d0b-ba81-ae4a568daca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:43.630124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f849f6-a4b1-4d0b-ba81-ae4a568daca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:43.630124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f849f6-a4b1-4d0b-ba81-ae4a568daca5 admin admin] PATH_INFO: `/v3/users/011345da81554c229044e85c7a2ffa8d` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:43.631469 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f849f6-a4b1-4d0b-ba81-ae4a568daca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011345da81554c229044e85c7a2ffa8d)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:43.633440 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f849f6-a4b1-4d0b-ba81-ae4a568daca5 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:43.873020 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-88f849f6-a4b1-4d0b-ba81-ae4a568daca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011345da81554c229044e85c7a2ffa8d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:43.873763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-88f849f6-a4b1-4d0b-ba81-ae4a568daca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011345da81554c229044e85c7a2ffa8d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:43.874834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-88f849f6-a4b1-4d0b-ba81-ae4a568daca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011345da81554c229044e85c7a2ffa8d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:43.952912 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-88f849f6-a4b1-4d0b-ba81-ae4a568daca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011345da81554c229044e85c7a2ffa8d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:43.966990 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-88f849f6-a4b1-4d0b-ba81-ae4a568daca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011345da81554c229044e85c7a2ffa8d'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:43.980143 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1440/2838] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:43 2022] DELETE /identity/v3/users/011345da81554c229044e85c7a2ffa8d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:44.422497 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:44.423958 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:44.438130 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a35a5c-aa8e-437b-a47b-f06576673a8e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:44.499026 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:44.499327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:44.499673 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:44.499946 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] PATH_INFO: `/v3/projects/2bb2e65e874b4ef9b7a08164b6c3ea13` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:44.501097 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb2e65e874b4ef9b7a08164b6c3ea13)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:44.503010 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:44.639736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb2e65e874b4ef9b7a08164b6c3ea13', 'request_id': 'req-98d3e454-2e50-4da5-8084-e85070e13841'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:44.645930 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb2e65e874b4ef9b7a08164b6c3ea13', 'request_id': 'req-98d3e454-2e50-4da5-8084-e85070e13841'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:44.740957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb2e65e874b4ef9b7a08164b6c3ea13', 'request_id': 'req-98d3e454-2e50-4da5-8084-e85070e13841'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:44.753481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] The token cache is being invalidate because project 2bb2e65e874b4ef9b7a08164b6c3ea13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:44.753776 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:44.754415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-98d3e454-2e50-4da5-8084-e85070e13841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:44.755984 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1399/2839] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:44 2022] DELETE /identity/v3/projects/2bb2e65e874b4ef9b7a08164b6c3ea13 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:44.763944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1ca8-dfa9-4bb6-b764-2f8915cc1e15 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:44.764448 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1ca8-dfa9-4bb6-b764-2f8915cc1e15 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:44.764876 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1ca8-dfa9-4bb6-b764-2f8915cc1e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:44.785443 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-a51e1ca8-dfa9-4bb6-b764-2f8915cc1e15 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:44.786657 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a51e1ca8-dfa9-4bb6-b764-2f8915cc1e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:44.845515 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1441/2840] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:44.854910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44551-e97e-48e5-b157-bbbe8fa5dc33 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:44.855246 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44551-e97e-48e5-b157-bbbe8fa5dc33 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:44.855524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44551-e97e-48e5-b157-bbbe8fa5dc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:44.875686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d5d44551-e97e-48e5-b157-bbbe8fa5dc33 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:44.876910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d5d44551-e97e-48e5-b157-bbbe8fa5dc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:44.884963 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1400/2841] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:44.889866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1ca8-dfa9-4bb6-b764-2f8915cc1e15 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:44.899529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1ca8-dfa9-4bb6-b764-2f8915cc1e15 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:44.904115 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b0980-25ae-4758-9c6c-3d0e9f1a4f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:44.904715 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b0980-25ae-4758-9c6c-3d0e9f1a4f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:44.904998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b0980-25ae-4758-9c6c-3d0e9f1a4f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:44.905276 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b0980-25ae-4758-9c6c-3d0e9f1a4f84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:44.905962 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b0980-25ae-4758-9c6c-3d0e9f1a4f84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:44.906269 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b0980-25ae-4758-9c6c-3d0e9f1a4f84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:44.907929 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b0980-25ae-4758-9c6c-3d0e9f1a4f84 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:44.920028 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1442/2842] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:44.924311 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d44551-e97e-48e5-b157-bbbe8fa5dc33 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:44.933562 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d44551-e97e-48e5-b157-bbbe8fa5dc33 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:44.938783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680b5a-bfe7-4a69-9b9f-d8f9954f44fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:44.939412 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680b5a-bfe7-4a69-9b9f-d8f9954f44fd admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:44.939695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680b5a-bfe7-4a69-9b9f-d8f9954f44fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:44.939970 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680b5a-bfe7-4a69-9b9f-d8f9954f44fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:44.940609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6680b5a-bfe7-4a69-9b9f-d8f9954f44fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:44.942508 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6680b5a-bfe7-4a69-9b9f-d8f9954f44fd admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:45.028524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1401/2843] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:44 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:45.032936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b0980-25ae-4758-9c6c-3d0e9f1a4f84 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:45.042847 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b0980-25ae-4758-9c6c-3d0e9f1a4f84 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:45.074367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:45.101548 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f0bb-d020-410d-9537-0547f62be061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:45.102233 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f0bb-d020-410d-9537-0547f62be061 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:45.102453 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f0bb-d020-410d-9537-0547f62be061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:45.102723 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f0bb-d020-410d-9537-0547f62be061 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:45.103428 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63f0bb-d020-410d-9537-0547f62be061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:45.105358 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63f0bb-d020-410d-9537-0547f62be061 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:45.258556 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1443/2844] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:45 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:45.260694 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680b5a-bfe7-4a69-9b9f-d8f9954f44fd admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:45.270965 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680b5a-bfe7-4a69-9b9f-d8f9954f44fd admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:45.275527 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75bfe4-7260-470a-82ac-c9393537cec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:45.276702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75bfe4-7260-470a-82ac-c9393537cec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:45.276702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75bfe4-7260-470a-82ac-c9393537cec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:45.276702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75bfe4-7260-470a-82ac-c9393537cec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:45.277291 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75bfe4-7260-470a-82ac-c9393537cec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:45.279441 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75bfe4-7260-470a-82ac-c9393537cec3 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:45.293791 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1402/2845] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:45.300048 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f0bb-d020-410d-9537-0547f62be061 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:45.310739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f0bb-d020-410d-9537-0547f62be061 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:45.315575 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3640e2-27c9-4f70-b1c9-b2709cf6cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:45.316187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3640e2-27c9-4f70-b1c9-b2709cf6cc2a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:45.316560 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3640e2-27c9-4f70-b1c9-b2709cf6cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:45.316860 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3640e2-27c9-4f70-b1c9-b2709cf6cc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:45.317532 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3640e2-27c9-4f70-b1c9-b2709cf6cc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:45.319125 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3640e2-27c9-4f70-b1c9-b2709cf6cc2a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:45.330210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1444/2846] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:45.334367 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75bfe4-7260-470a-82ac-c9393537cec3 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:45.345121 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75bfe4-7260-470a-82ac-c9393537cec3 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:45.349820 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05427528-8f0e-432b-93c7-563303fc52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:45.350502 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05427528-8f0e-432b-93c7-563303fc52ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:45.350783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05427528-8f0e-432b-93c7-563303fc52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:45.351082 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05427528-8f0e-432b-93c7-563303fc52ce admin admin] PATH_INFO: `/v3/projects/375c443ebdcc4ed7aa4252771000721b/users/2dc0bffcac89487a9b8c0435887c8337/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:45.366637 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05427528-8f0e-432b-93c7-563303fc52ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=375c443ebdcc4ed7aa4252771000721b, user_id=2dc0bffcac89487a9b8c0435887c8337, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:45.369366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05427528-8f0e-432b-93c7-563303fc52ce admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:45.480804 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:45.486287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1403/2847] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:45 2022] PUT /identity/v3/projects/375c443ebdcc4ed7aa4252771000721b/users/2dc0bffcac89487a9b8c0435887c8337/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:45.497671 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d322943-e09b-44c7-a2fb-972ced540670 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:45.498009 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d322943-e09b-44c7-a2fb-972ced540670 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:45.498287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d322943-e09b-44c7-a2fb-972ced540670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:45.527301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-8d322943-e09b-44c7-a2fb-972ced540670 None None] MFA Rules not processed for user `2dc0bffcac89487a9b8c0435887c8337`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:45.529021 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d322943-e09b-44c7-a2fb-972ced540670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:45.596838 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1445/2848] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:45.610042 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05427528-8f0e-432b-93c7-563303fc52ce admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:45.611957 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-05427528-8f0e-432b-93c7-563303fc52ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:45.671254 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05427528-8f0e-432b-93c7-563303fc52ce admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:45.675216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d627d-81bb-406e-aaff-3e0916205a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:45.675848 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d627d-81bb-406e-aaff-3e0916205a9c service cinder] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:45.676135 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d627d-81bb-406e-aaff-3e0916205a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:45.676416 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d627d-81bb-406e-aaff-3e0916205a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:45.685690 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d627d-81bb-406e-aaff-3e0916205a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:45.687175 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d627d-81bb-406e-aaff-3e0916205a9c service cinder] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:45.696620 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1404/2849] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:48.893969 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d322943-e09b-44c7-a2fb-972ced540670 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:48.895557 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-8d322943-e09b-44c7-a2fb-972ced540670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:48.960745 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d322943-e09b-44c7-a2fb-972ced540670 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:48.965447 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:48.966153 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:48.966434 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:48.966711 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] PATH_INFO: `/v3/users/6285e8cdfe344b6398cfac797b8cb899` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:48.967897 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6285e8cdfe344b6398cfac797b8cb899)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:48.969873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:49.132763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:49.137861 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6285e8cdfe344b6398cfac797b8cb899'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.138531 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6285e8cdfe344b6398cfac797b8cb899'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.139171 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6285e8cdfe344b6398cfac797b8cb899'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.210308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6285e8cdfe344b6398cfac797b8cb899'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.223311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6285e8cdfe344b6398cfac797b8cb899'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.236089 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1446/2850] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:48 2022] DELETE /identity/v3/users/6285e8cdfe344b6398cfac797b8cb899 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:49.240657 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063b52-a44f-4832-a6f8-cd8c9dcb7847 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:49.241739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063b52-a44f-4832-a6f8-cd8c9dcb7847 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:49.241739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063b52-a44f-4832-a6f8-cd8c9dcb7847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:49.260623 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-69063b52-a44f-4832-a6f8-cd8c9dcb7847 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:49.261816 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-69063b52-a44f-4832-a6f8-cd8c9dcb7847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:49.333227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1405/2851] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:49.345429 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:49.346913 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:49.406906 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e4699-acf5-4028-b0a7-e3bd522aeaa0 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:49.410651 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe64e1-e15e-4417-8a49-847ad02df13c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:49.411298 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe64e1-e15e-4417-8a49-847ad02df13c service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:49.411611 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe64e1-e15e-4417-8a49-847ad02df13c service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:49.417288 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe64e1-e15e-4417-8a49-847ad02df13c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:49.421529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe64e1-e15e-4417-8a49-847ad02df13c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:49.422979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe64e1-e15e-4417-8a49-847ad02df13c service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:49.432565 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1447/2852] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:49.857183 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063b52-a44f-4832-a6f8-cd8c9dcb7847 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:49.859119 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-69063b52-a44f-4832-a6f8-cd8c9dcb7847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:49.880884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063b52-a44f-4832-a6f8-cd8c9dcb7847 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:49.882569 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:49.883374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:49.883754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:49.884146 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] PATH_INFO: `/v3/projects/bedccccf09a34c848a2aaa1f55186fad` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:49.885487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bedccccf09a34c848a2aaa1f55186fad)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:49.887599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:49.985763 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bedccccf09a34c848a2aaa1f55186fad', 'request_id': 'req-3037502c-d54a-40a4-9651-d860563a8300'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.991364 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bedccccf09a34c848a2aaa1f55186fad', 'request_id': 'req-3037502c-d54a-40a4-9651-d860563a8300'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:50.072949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bedccccf09a34c848a2aaa1f55186fad', 'request_id': 'req-3037502c-d54a-40a4-9651-d860563a8300'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:50.085662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] The token cache is being invalidate because project bedccccf09a34c848a2aaa1f55186fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:50.085955 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:50.086811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-3037502c-d54a-40a4-9651-d860563a8300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:50.088616 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1406/2853] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:49 2022] DELETE /identity/v3/projects/bedccccf09a34c848a2aaa1f55186fad => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:50.093833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446ad44-5e55-4561-b523-f1c3034f6ee6 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.094313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446ad44-5e55-4561-b523-f1c3034f6ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.094409 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446ad44-5e55-4561-b523-f1c3034f6ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.114195 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-9446ad44-5e55-4561-b523-f1c3034f6ee6 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:50.115437 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9446ad44-5e55-4561-b523-f1c3034f6ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:50.180335 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1448/2854] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:50.188933 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414679-c7ec-48fa-be37-3606797bfa9b None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.189224 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414679-c7ec-48fa-be37-3606797bfa9b None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.189506 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414679-c7ec-48fa-be37-3606797bfa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.209943 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-bd414679-c7ec-48fa-be37-3606797bfa9b None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:50.211215 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-bd414679-c7ec-48fa-be37-3606797bfa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:50.219721 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1407/2855] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:50.224067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446ad44-5e55-4561-b523-f1c3034f6ee6 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.234792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446ad44-5e55-4561-b523-f1c3034f6ee6 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.239525 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dfe69-823e-433c-8ca9-bc46a865c97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.240135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dfe69-823e-433c-8ca9-bc46a865c97a admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.240419 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dfe69-823e-433c-8ca9-bc46a865c97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.240729 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dfe69-823e-433c-8ca9-bc46a865c97a admin admin] PATH_INFO: `/v3/domains` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.241382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dfe69-823e-433c-8ca9-bc46a865c97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81854) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:50.241690 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dfe69-823e-433c-8ca9-bc46a865c97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.243398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dfe69-823e-433c-8ca9-bc46a865c97a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.256085 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1449/2856] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:50.260695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd414679-c7ec-48fa-be37-3606797bfa9b None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.270448 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd414679-c7ec-48fa-be37-3606797bfa9b None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.275428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2066f-a995-4210-87f1-eb48245aa71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.276025 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2066f-a995-4210-87f1-eb48245aa71f admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.276308 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2066f-a995-4210-87f1-eb48245aa71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.276586 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2066f-a995-4210-87f1-eb48245aa71f admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.277229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2066f-a995-4210-87f1-eb48245aa71f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.279287 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2066f-a995-4210-87f1-eb48245aa71f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.374879 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:50.381991 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1408/2857] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:50 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:50.386415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dfe69-823e-433c-8ca9-bc46a865c97a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.396617 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dfe69-823e-433c-8ca9-bc46a865c97a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.441866 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:50.453678 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287de0c6-5e72-4d73-b59b-367e06e8c563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.454282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287de0c6-5e72-4d73-b59b-367e06e8c563 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.454561 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287de0c6-5e72-4d73-b59b-367e06e8c563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.454834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287de0c6-5e72-4d73-b59b-367e06e8c563 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.455489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287de0c6-5e72-4d73-b59b-367e06e8c563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.457418 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287de0c6-5e72-4d73-b59b-367e06e8c563 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.527921 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1450/2858] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:50 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:50.532597 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2066f-a995-4210-87f1-eb48245aa71f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.542885 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2066f-a995-4210-87f1-eb48245aa71f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.548360 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95bae5-1504-4cd7-98c7-5d65cf24b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.548949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95bae5-1504-4cd7-98c7-5d65cf24b245 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.549229 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95bae5-1504-4cd7-98c7-5d65cf24b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.549737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95bae5-1504-4cd7-98c7-5d65cf24b245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.550201 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95bae5-1504-4cd7-98c7-5d65cf24b245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.551940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95bae5-1504-4cd7-98c7-5d65cf24b245 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.562301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1409/2859] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:50.566205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287de0c6-5e72-4d73-b59b-367e06e8c563 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.576937 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287de0c6-5e72-4d73-b59b-367e06e8c563 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.581572 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04c046-a47a-400b-b8cc-585854e1244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.582926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c046-a47a-400b-b8cc-585854e1244d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.582926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c046-a47a-400b-b8cc-585854e1244d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.582926 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c046-a47a-400b-b8cc-585854e1244d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.583504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04c046-a47a-400b-b8cc-585854e1244d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.585097 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04c046-a47a-400b-b8cc-585854e1244d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.596562 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1451/2860] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:50.600818 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95bae5-1504-4cd7-98c7-5d65cf24b245 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.612410 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95bae5-1504-4cd7-98c7-5d65cf24b245 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.616560 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6aa0e-5b05-473d-b35d-57dee9d4ff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.617252 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6aa0e-5b05-473d-b35d-57dee9d4ff13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.617532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6aa0e-5b05-473d-b35d-57dee9d4ff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.617887 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6aa0e-5b05-473d-b35d-57dee9d4ff13 admin admin] PATH_INFO: `/v3/projects/f828fccb789942e4b2805727c4d2841a/users/c7299595b81340298789792e00b2bfaa/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.634537 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6aa0e-5b05-473d-b35d-57dee9d4ff13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f828fccb789942e4b2805727c4d2841a, user_id=c7299595b81340298789792e00b2bfaa, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.637171 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6aa0e-5b05-473d-b35d-57dee9d4ff13 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.751365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1410/2861] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:50 2022] PUT /identity/v3/projects/f828fccb789942e4b2805727c4d2841a/users/c7299595b81340298789792e00b2bfaa/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:50.756472 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94498fa-a428-4c60-afa7-189c10d3ce02 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.756762 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94498fa-a428-4c60-afa7-189c10d3ce02 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.757037 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94498fa-a428-4c60-afa7-189c10d3ce02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.776113 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-f94498fa-a428-4c60-afa7-189c10d3ce02 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:50.777367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f94498fa-a428-4c60-afa7-189c10d3ce02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:50.837403 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1452/2862] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:50.847779 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6aa0e-5b05-473d-b35d-57dee9d4ff13 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.849551 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d3f6aa0e-5b05-473d-b35d-57dee9d4ff13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:50.908565 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6aa0e-5b05-473d-b35d-57dee9d4ff13 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.912176 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daa863-8521-42bd-ab77-773e9cad8571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.912777 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa863-8521-42bd-ab77-773e9cad8571 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.913058 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa863-8521-42bd-ab77-773e9cad8571 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.913333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa863-8521-42bd-ab77-773e9cad8571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.922329 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daa863-8521-42bd-ab77-773e9cad8571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.923880 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daa863-8521-42bd-ab77-773e9cad8571 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.933366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1411/2863] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:56.453308 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393701f8-61cb-4f37-86f8-22499397571d None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:56.454095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393701f8-61cb-4f37-86f8-22499397571d None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:56.454095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393701f8-61cb-4f37-86f8-22499397571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:56.485833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-393701f8-61cb-4f37-86f8-22499397571d None None] MFA Rules not processed for user `c7299595b81340298789792e00b2bfaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:56.487178 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-393701f8-61cb-4f37-86f8-22499397571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:56.564018 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1453/2864] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:56:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:56.568545 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daa863-8521-42bd-ab77-773e9cad8571 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:56.581227 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daa863-8521-42bd-ab77-773e9cad8571 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:56.586126 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f95b7-d173-4418-afa7-08d68931abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:56.586739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f95b7-d173-4418-afa7-08d68931abfb admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:56.587027 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f95b7-d173-4418-afa7-08d68931abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:56.587404 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f95b7-d173-4418-afa7-08d68931abfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:56.588053 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f95b7-d173-4418-afa7-08d68931abfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:56.589999 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f95b7-d173-4418-afa7-08d68931abfb admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:56.686739 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1412/2865] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:56 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:56.690092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393701f8-61cb-4f37-86f8-22499397571d None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:56.701936 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393701f8-61cb-4f37-86f8-22499397571d None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:56.770104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:56.782191 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c528ef5-a612-43ff-92a7-00878ed92e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:56.782820 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c528ef5-a612-43ff-92a7-00878ed92e76 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:56.783163 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c528ef5-a612-43ff-92a7-00878ed92e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:56.788568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c528ef5-a612-43ff-92a7-00878ed92e76 admin admin] PATH_INFO: `/v3/users` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:56.788568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c528ef5-a612-43ff-92a7-00878ed92e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:56.788568 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c528ef5-a612-43ff-92a7-00878ed92e76 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:56.923495 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1454/2866] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:56 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:56.927928 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f95b7-d173-4418-afa7-08d68931abfb admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:56.945576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f95b7-d173-4418-afa7-08d68931abfb admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:56.951361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3db2f-0e45-44f5-bbf5-c236f7d63149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:56.951975 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3db2f-0e45-44f5-bbf5-c236f7d63149 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:56.952261 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3db2f-0e45-44f5-bbf5-c236f7d63149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:56.952540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3db2f-0e45-44f5-bbf5-c236f7d63149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:56.953200 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3db2f-0e45-44f5-bbf5-c236f7d63149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:56.954814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3db2f-0e45-44f5-bbf5-c236f7d63149 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:56.967235 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1413/2867] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:56.971528 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c528ef5-a612-43ff-92a7-00878ed92e76 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:56.981893 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c528ef5-a612-43ff-92a7-00878ed92e76 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:56.986511 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188e453-9d15-43ae-976f-65488d28e629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:56.987210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188e453-9d15-43ae-976f-65488d28e629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:56.987493 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188e453-9d15-43ae-976f-65488d28e629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:56.987767 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188e453-9d15-43ae-976f-65488d28e629 admin admin] PATH_INFO: `/v3/projects/a42313e500a349aeb8e154b129089ac3/users/5ac587b5a69e492bae8dd42007d2e132/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:57.002892 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188e453-9d15-43ae-976f-65488d28e629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42313e500a349aeb8e154b129089ac3, user_id=5ac587b5a69e492bae8dd42007d2e132, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:57.005591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188e453-9d15-43ae-976f-65488d28e629 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:57.096261 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1455/2868] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:56 2022] PUT /identity/v3/projects/a42313e500a349aeb8e154b129089ac3/users/5ac587b5a69e492bae8dd42007d2e132/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:57.100313 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3db2f-0e45-44f5-bbf5-c236f7d63149 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:57.111954 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3db2f-0e45-44f5-bbf5-c236f7d63149 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:57.189929 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681e8ba-82a8-4074-aa5c-dd930a216a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:57.190608 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e8ba-82a8-4074-aa5c-dd930a216a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:57.190896 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e8ba-82a8-4074-aa5c-dd930a216a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:57.191270 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e8ba-82a8-4074-aa5c-dd930a216a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:57.192038 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681e8ba-82a8-4074-aa5c-dd930a216a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:57.193976 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681e8ba-82a8-4074-aa5c-dd930a216a1c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:57.205877 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1414/2869] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:57.210062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188e453-9d15-43ae-976f-65488d28e629 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:57.221038 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188e453-9d15-43ae-976f-65488d28e629 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:57.225831 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e90c12-7a66-4d83-9526-182939ec3351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:57.226479 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e90c12-7a66-4d83-9526-182939ec3351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:57.226758 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e90c12-7a66-4d83-9526-182939ec3351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:57.227025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e90c12-7a66-4d83-9526-182939ec3351 admin admin] PATH_INFO: `/v3/projects/a42313e500a349aeb8e154b129089ac3/users/5ac587b5a69e492bae8dd42007d2e132/roles/7ce3b13a76bd4874b1f4a9c205289133` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:57.229024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e90c12-7a66-4d83-9526-182939ec3351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42313e500a349aeb8e154b129089ac3, user_id=5ac587b5a69e492bae8dd42007d2e132, role_id=7ce3b13a76bd4874b1f4a9c205289133)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:57.233126 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e90c12-7a66-4d83-9526-182939ec3351 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:57.244110 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1456/2870] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:57 2022] PUT /identity/v3/projects/a42313e500a349aeb8e154b129089ac3/users/5ac587b5a69e492bae8dd42007d2e132/roles/7ce3b13a76bd4874b1f4a9c205289133 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:03.584722 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce13b5-f5df-431b-82bb-86940286a2e8 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:03.585362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce13b5-f5df-431b-82bb-86940286a2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:03.585362 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce13b5-f5df-431b-82bb-86940286a2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:03.616830 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-39ce13b5-f5df-431b-82bb-86940286a2e8 None None] MFA Rules not processed for user `5ac587b5a69e492bae8dd42007d2e132`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:03.618054 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-39ce13b5-f5df-431b-82bb-86940286a2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:03.639131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:03.698032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1415/2871] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:57:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:03.714322 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e90c12-7a66-4d83-9526-182939ec3351 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:03.716151 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-73e90c12-7a66-4d83-9526-182939ec3351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:03.832282 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e90c12-7a66-4d83-9526-182939ec3351 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:03.837862 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08160790-d209-4f25-8a0a-a931bb02fbbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:03.838968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08160790-d209-4f25-8a0a-a931bb02fbbd service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:03.838968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08160790-d209-4f25-8a0a-a931bb02fbbd service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:03.839411 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08160790-d209-4f25-8a0a-a931bb02fbbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:03.932090 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08160790-d209-4f25-8a0a-a931bb02fbbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:03.933852 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08160790-d209-4f25-8a0a-a931bb02fbbd service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:03.943025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1457/2872] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:06.702043 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e77d-8c70-4ca8-b28b-c275b698429d None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:06.702590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e77d-8c70-4ca8-b28b-c275b698429d None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:06.702590 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e77d-8c70-4ca8-b28b-c275b698429d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:06.722822 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-f232e77d-8c70-4ca8-b28b-c275b698429d None None] MFA Rules not processed for user `c7299595b81340298789792e00b2bfaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:06.724096 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f232e77d-8c70-4ca8-b28b-c275b698429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:06.731983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1416/2873] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:57:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:13.938732 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:14.767369 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08160790-d209-4f25-8a0a-a931bb02fbbd service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:14.768911 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-08160790-d209-4f25-8a0a-a931bb02fbbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:14.875974 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08160790-d209-4f25-8a0a-a931bb02fbbd service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:14.881141 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe2c55-f267-4378-93fa-98fd24a14546 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:14.881743 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe2c55-f267-4378-93fa-98fd24a14546 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:14.882026 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe2c55-f267-4378-93fa-98fd24a14546 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:14.882303 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe2c55-f267-4378-93fa-98fd24a14546 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:14.884051 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9ffe2c55-f267-4378-93fa-98fd24a14546 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:14.896045 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe2c55-f267-4378-93fa-98fd24a14546 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:14.897634 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe2c55-f267-4378-93fa-98fd24a14546 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:14.907504 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1458/2874] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:16.717738 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=24 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:23.743365 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232e77d-8c70-4ca8-b28b-c275b698429d None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:23.744841 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-f232e77d-8c70-4ca8-b28b-c275b698429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:23.811572 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232e77d-8c70-4ca8-b28b-c275b698429d None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:23.816953 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:23.817587 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:23.817874 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:23.818152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] PATH_INFO: `/v3/users/2dc0bffcac89487a9b8c0435887c8337` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:23.819325 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc0bffcac89487a9b8c0435887c8337)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:23.821559 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:24.188956 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc0bffcac89487a9b8c0435887c8337'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:24.265664 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc0bffcac89487a9b8c0435887c8337'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:24.273248 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc0bffcac89487a9b8c0435887c8337'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:24.273891 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc0bffcac89487a9b8c0435887c8337'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:24.286265 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc0bffcac89487a9b8c0435887c8337'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:24.292112 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1417/2875] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:23 2022] DELETE /identity/v3/users/2dc0bffcac89487a9b8c0435887c8337 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:24.297422 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d447-2894-4d4e-bfc2-ee42f2bf6ed5 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:24.297950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d447-2894-4d4e-bfc2-ee42f2bf6ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:24.297950 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d447-2894-4d4e-bfc2-ee42f2bf6ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:24.317114 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-4941d447-2894-4d4e-bfc2-ee42f2bf6ed5 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:24.318312 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4941d447-2894-4d4e-bfc2-ee42f2bf6ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:24.388763 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1459/2876] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:24.398686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:24.400963 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:24.469599 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad3d56-65d3-4e00-9374-37d83aafb05b admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:24.473333 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43fb91-8bd6-45e4-8903-ad0c73d32ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:24.473944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43fb91-8bd6-45e4-8903-ad0c73d32ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:24.474225 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43fb91-8bd6-45e4-8903-ad0c73d32ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:24.474498 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43fb91-8bd6-45e4-8903-ad0c73d32ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:24.484899 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43fb91-8bd6-45e4-8903-ad0c73d32ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:24.486374 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43fb91-8bd6-45e4-8903-ad0c73d32ee1 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:24.496811 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1418/2877] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:25.330873 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941d447-2894-4d4e-bfc2-ee42f2bf6ed5 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:25.332406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4941d447-2894-4d4e-bfc2-ee42f2bf6ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:25.350420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941d447-2894-4d4e-bfc2-ee42f2bf6ed5 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:25.355143 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:25.355794 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:25.356079 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:25.356381 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] PATH_INFO: `/v3/projects/375c443ebdcc4ed7aa4252771000721b` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:25.357571 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=375c443ebdcc4ed7aa4252771000721b)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:25.359538 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:25.519179 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '375c443ebdcc4ed7aa4252771000721b', 'request_id': 'req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:25.585920 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '375c443ebdcc4ed7aa4252771000721b', 'request_id': 'req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:25.591833 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '375c443ebdcc4ed7aa4252771000721b', 'request_id': 'req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:25.593500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:25.604234 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] The token cache is being invalidate because project 375c443ebdcc4ed7aa4252771000721b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:25.604529 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:25.605196 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-2e63cf2f-e8cc-4aee-b3f1-3c01a4927c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:25.606685 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1460/2878] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:25 2022] DELETE /identity/v3/projects/375c443ebdcc4ed7aa4252771000721b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:25.612024 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acece58c-3622-40f0-ade7-02ed36e866c9 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:25.612514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acece58c-3622-40f0-ade7-02ed36e866c9 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:25.612613 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acece58c-3622-40f0-ade7-02ed36e866c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:25.632514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-acece58c-3622-40f0-ade7-02ed36e866c9 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:25.633735 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-acece58c-3622-40f0-ade7-02ed36e866c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:25.652685 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:25.697286 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1419/2879] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:25.767442 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75708c27-7dc5-4926-967e-1751444ff6ec None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:25.767442 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75708c27-7dc5-4926-967e-1751444ff6ec None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:25.777213 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75708c27-7dc5-4926-967e-1751444ff6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:25.820666 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-75708c27-7dc5-4926-967e-1751444ff6ec None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:25.821914 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-75708c27-7dc5-4926-967e-1751444ff6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:25.830683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1461/2880] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:25.834632 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acece58c-3622-40f0-ade7-02ed36e866c9 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:25.851478 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acece58c-3622-40f0-ade7-02ed36e866c9 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:25.857363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638315d0-1558-4015-823a-40f34a1fc34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:25.858064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638315d0-1558-4015-823a-40f34a1fc34a admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:25.859486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638315d0-1558-4015-823a-40f34a1fc34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:25.859486 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638315d0-1558-4015-823a-40f34a1fc34a admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:25.860081 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638315d0-1558-4015-823a-40f34a1fc34a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:57:25.860397 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638315d0-1558-4015-823a-40f34a1fc34a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:25.871293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638315d0-1558-4015-823a-40f34a1fc34a admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:25.883091 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1420/2881] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:57:25.885907 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75708c27-7dc5-4926-967e-1751444ff6ec None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:25.896642 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75708c27-7dc5-4926-967e-1751444ff6ec None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:25.901521 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b582e45-6a2f-4ccc-9e6c-84fe27db7b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:25.902136 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b582e45-6a2f-4ccc-9e6c-84fe27db7b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:25.902420 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b582e45-6a2f-4ccc-9e6c-84fe27db7b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:25.902705 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b582e45-6a2f-4ccc-9e6c-84fe27db7b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:25.903537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b582e45-6a2f-4ccc-9e6c-84fe27db7b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:25.905786 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b582e45-6a2f-4ccc-9e6c-84fe27db7b64 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:26.050844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1462/2882] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:25 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:26.054962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638315d0-1558-4015-823a-40f34a1fc34a admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:26.065253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638315d0-1558-4015-823a-40f34a1fc34a admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:26.131925 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032af925-6aaf-43a8-a1b6-477b66c5c4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:26.132499 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032af925-6aaf-43a8-a1b6-477b66c5c4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:26.132784 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032af925-6aaf-43a8-a1b6-477b66c5c4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:26.133062 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032af925-6aaf-43a8-a1b6-477b66c5c4a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:26.133702 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032af925-6aaf-43a8-a1b6-477b66c5c4a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:26.135695 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032af925-6aaf-43a8-a1b6-477b66c5c4a8 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:26.226971 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1421/2883] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:26 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:26.231203 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b582e45-6a2f-4ccc-9e6c-84fe27db7b64 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:26.242423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b582e45-6a2f-4ccc-9e6c-84fe27db7b64 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:26.247210 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dce43f-e3d7-4d38-bb26-ef5ab741d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:26.247822 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dce43f-e3d7-4d38-bb26-ef5ab741d15f admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:26.248104 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dce43f-e3d7-4d38-bb26-ef5ab741d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:26.248382 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dce43f-e3d7-4d38-bb26-ef5ab741d15f admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:26.249680 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dce43f-e3d7-4d38-bb26-ef5ab741d15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:26.251340 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dce43f-e3d7-4d38-bb26-ef5ab741d15f admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:26.261341 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1463/2884] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:26.265514 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032af925-6aaf-43a8-a1b6-477b66c5c4a8 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:26.275678 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032af925-6aaf-43a8-a1b6-477b66c5c4a8 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:26.280366 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21dc46-d6e0-481e-81cb-6e5cf6f7a9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:26.280962 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21dc46-d6e0-481e-81cb-6e5cf6f7a9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:26.281626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21dc46-d6e0-481e-81cb-6e5cf6f7a9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:26.281626 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21dc46-d6e0-481e-81cb-6e5cf6f7a9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:26.282148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21dc46-d6e0-481e-81cb-6e5cf6f7a9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:26.283837 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21dc46-d6e0-481e-81cb-6e5cf6f7a9a4 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:26.294892 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1422/2885] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:57:26.299830 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dce43f-e3d7-4d38-bb26-ef5ab741d15f admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:26.310258 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dce43f-e3d7-4d38-bb26-ef5ab741d15f admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:26.316311 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8abc06-4511-4ce0-8ddc-a790a8774d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:26.317002 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8abc06-4511-4ce0-8ddc-a790a8774d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:26.327701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8abc06-4511-4ce0-8ddc-a790a8774d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:26.327701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8abc06-4511-4ce0-8ddc-a790a8774d15 admin admin] PATH_INFO: `/v3/projects/efb52454b328476e9b0086b11fe6136c/users/c996a2413408400aaca48d0684ba6a53/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:26.334459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8abc06-4511-4ce0-8ddc-a790a8774d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb52454b328476e9b0086b11fe6136c, user_id=c996a2413408400aaca48d0684ba6a53, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:26.337173 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8abc06-4511-4ce0-8ddc-a790a8774d15 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:26.410584 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1464/2886] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:26 2022] PUT /identity/v3/projects/efb52454b328476e9b0086b11fe6136c/users/c996a2413408400aaca48d0684ba6a53/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:57:26.420742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557e234-30c2-42a0-a973-1271918b0df3 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:26.421624 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557e234-30c2-42a0-a973-1271918b0df3 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:26.422303 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557e234-30c2-42a0-a973-1271918b0df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:26.449825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-e557e234-30c2-42a0-a973-1271918b0df3 None None] MFA Rules not processed for user `c996a2413408400aaca48d0684ba6a53`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:26.451137 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e557e234-30c2-42a0-a973-1271918b0df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:26.516561 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1423/2887] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:57:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:57:26.528223 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8abc06-4511-4ce0-8ddc-a790a8774d15 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:26.529998 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-9b8abc06-4511-4ce0-8ddc-a790a8774d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:26.599683 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8abc06-4511-4ce0-8ddc-a790a8774d15 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:26.603520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13611f36-176b-4e73-975d-a7b1295394b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:26.604133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13611f36-176b-4e73-975d-a7b1295394b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:26.604415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13611f36-176b-4e73-975d-a7b1295394b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:26.604689 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13611f36-176b-4e73-975d-a7b1295394b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:26.613166 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13611f36-176b-4e73-975d-a7b1295394b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:26.614605 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13611f36-176b-4e73-975d-a7b1295394b7 service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:26.623590 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1465/2888] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:26.650046 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557e234-30c2-42a0-a973-1271918b0df3 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:26.674940 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:26.718801 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557e234-30c2-42a0-a973-1271918b0df3 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:26.723527 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:26.724138 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:26.724417 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:26.724692 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] PATH_INFO: `/v3/users/c996a2413408400aaca48d0684ba6a53` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:26.725825 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c996a2413408400aaca48d0684ba6a53)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:26.727871 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:27.046573 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c996a2413408400aaca48d0684ba6a53'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:27.168662 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c996a2413408400aaca48d0684ba6a53'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:27.177041 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c996a2413408400aaca48d0684ba6a53'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:27.177676 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c996a2413408400aaca48d0684ba6a53'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:27.192203 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c996a2413408400aaca48d0684ba6a53'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:27.196170 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1424/2889] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:26 2022] DELETE /identity/v3/users/c996a2413408400aaca48d0684ba6a53 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:27.200630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3b602-2d64-4a86-9ea7-727b1c2042c9 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:27.200915 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3b602-2d64-4a86-9ea7-727b1c2042c9 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:27.201187 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3b602-2d64-4a86-9ea7-727b1c2042c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:27.220317 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-3fc3b602-2d64-4a86-9ea7-727b1c2042c9 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:27.221510 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3fc3b602-2d64-4a86-9ea7-727b1c2042c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:27.283072 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1466/2890] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:27.293039 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:27.294609 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:27.352117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef1cbd-b34b-4540-8de4-97e500cdcb1f admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:27.355771 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e334c7-b421-4771-a38e-cfc91559fd1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:27.356380 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e334c7-b421-4771-a38e-cfc91559fd1b service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:27.356666 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e334c7-b421-4771-a38e-cfc91559fd1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:27.356944 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e334c7-b421-4771-a38e-cfc91559fd1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:27.366532 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e334c7-b421-4771-a38e-cfc91559fd1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:27.368020 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e334c7-b421-4771-a38e-cfc91559fd1b service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:27.378057 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1425/2891] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:27.873069 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3b602-2d64-4a86-9ea7-727b1c2042c9 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:27.875431 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-3fc3b602-2d64-4a86-9ea7-727b1c2042c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:27.888460 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3b602-2d64-4a86-9ea7-727b1c2042c9 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:27.893667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:27.894507 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:27.894895 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:27.895264 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] PATH_INFO: `/v3/projects/efb52454b328476e9b0086b11fe6136c` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:27.897062 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb52454b328476e9b0086b11fe6136c)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:27.899145 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:28.011027 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:28.026667 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb52454b328476e9b0086b11fe6136c', 'request_id': 'req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:28.123374 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb52454b328476e9b0086b11fe6136c', 'request_id': 'req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:28.129871 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb52454b328476e9b0086b11fe6136c', 'request_id': 'req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:28.142011 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] The token cache is being invalidate because project efb52454b328476e9b0086b11fe6136c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:28.142302 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:28.147268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-f6b19a7a-c51b-4a7c-90f5-984d17481b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:28.147268 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1467/2892] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:27 2022] DELETE /identity/v3/projects/efb52454b328476e9b0086b11fe6136c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:28.149555 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509c4a-73e3-462f-b31f-87bd3240e6c0 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:28.150195 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509c4a-73e3-462f-b31f-87bd3240e6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:28.150320 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509c4a-73e3-462f-b31f-87bd3240e6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:28.169737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-72509c4a-73e3-462f-b31f-87bd3240e6c0 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:28.170952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-72509c4a-73e3-462f-b31f-87bd3240e6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:28.207099 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:28.231949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1426/2893] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:28.239659 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388e583-beda-4b72-9e9b-ab368da068c1 None None] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:28.239944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388e583-beda-4b72-9e9b-ab368da068c1 None None] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:28.240227 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388e583-beda-4b72-9e9b-ab368da068c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:28.260220 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.auth.core [None req-7388e583-beda-4b72-9e9b-ab368da068c1 None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81854) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:28.261462 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-7388e583-beda-4b72-9e9b-ab368da068c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:28.269983 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1468/2894] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:28.274321 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72509c4a-73e3-462f-b31f-87bd3240e6c0 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:28.284710 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72509c4a-73e3-462f-b31f-87bd3240e6c0 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:28.289974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d59a-4925-49a1-90a6-f2c748543630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:28.289974 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d59a-4925-49a1-90a6-f2c748543630 admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:28.290257 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d59a-4925-49a1-90a6-f2c748543630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:28.290470 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d59a-4925-49a1-90a6-f2c748543630 admin admin] PATH_INFO: `/v3/domains` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:28.291152 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89d59a-4925-49a1-90a6-f2c748543630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81855) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:57:28.291458 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89d59a-4925-49a1-90a6-f2c748543630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:28.293072 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89d59a-4925-49a1-90a6-f2c748543630 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:28.309692 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1427/2895] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 03:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:57:28.314555 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388e583-beda-4b72-9e9b-ab368da068c1 None None] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:28.324342 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388e583-beda-4b72-9e9b-ab368da068c1 None None] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:28.329501 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eccca6-36af-4d83-bbb0-7dd7d41c933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:28.330124 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eccca6-36af-4d83-bbb0-7dd7d41c933a admin admin] REQUEST_METHOD: `POST` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:28.330412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eccca6-36af-4d83-bbb0-7dd7d41c933a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:28.330692 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eccca6-36af-4d83-bbb0-7dd7d41c933a admin admin] PATH_INFO: `/v3/projects` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:28.331366 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eccca6-36af-4d83-bbb0-7dd7d41c933a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:28.333381 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eccca6-36af-4d83-bbb0-7dd7d41c933a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:28.456439 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1469/2896] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:28 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:28.460881 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d59a-4925-49a1-90a6-f2c748543630 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:28.471913 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d59a-4925-49a1-90a6-f2c748543630 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:28.530698 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb59a4-8766-4ff7-9bdd-69b003fb9161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:28.531327 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb59a4-8766-4ff7-9bdd-69b003fb9161 admin admin] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:28.531612 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb59a4-8766-4ff7-9bdd-69b003fb9161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:28.531891 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb59a4-8766-4ff7-9bdd-69b003fb9161 admin admin] PATH_INFO: `/v3/users` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:28.532536 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb59a4-8766-4ff7-9bdd-69b003fb9161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:28.534471 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb59a4-8766-4ff7-9bdd-69b003fb9161 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:28.637584 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1428/2897] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:28 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:28.642417 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eccca6-36af-4d83-bbb0-7dd7d41c933a admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:28.653676 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eccca6-36af-4d83-bbb0-7dd7d41c933a admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:28.660074 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa4f7-a2c3-4698-a247-ab93311d3a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:28.660694 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa4f7-a2c3-4698-a247-ab93311d3a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:28.660979 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa4f7-a2c3-4698-a247-ab93311d3a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:28.661255 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa4f7-a2c3-4698-a247-ab93311d3a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:28.661968 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aa4f7-a2c3-4698-a247-ab93311d3a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:28.663644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aa4f7-a2c3-4698-a247-ab93311d3a8d admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:28.677230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1470/2898] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:28.678328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb59a4-8766-4ff7-9bdd-69b003fb9161 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:28.689918 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb59a4-8766-4ff7-9bdd-69b003fb9161 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:28.694782 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94268e80-b2e6-40cc-ad08-da0619fbe51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:28.695668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94268e80-b2e6-40cc-ad08-da0619fbe51f admin admin] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:28.695952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94268e80-b2e6-40cc-ad08-da0619fbe51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:28.696226 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94268e80-b2e6-40cc-ad08-da0619fbe51f admin admin] PATH_INFO: `/v3/roles` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:28.696884 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94268e80-b2e6-40cc-ad08-da0619fbe51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:28.698859 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94268e80-b2e6-40cc-ad08-da0619fbe51f admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:28.711283 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1429/2899] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:28.715542 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa4f7-a2c3-4698-a247-ab93311d3a8d admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:28.725841 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa4f7-a2c3-4698-a247-ab93311d3a8d admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:28.730886 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bda53-74bd-4005-b6e7-7c3ab371b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:28.731583 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bda53-74bd-4005-b6e7-7c3ab371b3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:28.731867 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bda53-74bd-4005-b6e7-7c3ab371b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:28.732161 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bda53-74bd-4005-b6e7-7c3ab371b3fb admin admin] PATH_INFO: `/v3/projects/2afed941475c4d9f9a113a9922027649/users/0fed525003294b819d27a6412ca75073/roles/8689bf0d70184aef9148c6b4a9758b32` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:28.748015 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bda53-74bd-4005-b6e7-7c3ab371b3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afed941475c4d9f9a113a9922027649, user_id=0fed525003294b819d27a6412ca75073, role_id=8689bf0d70184aef9148c6b4a9758b32)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:28.751464 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bda53-74bd-4005-b6e7-7c3ab371b3fb admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:28.855146 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1471/2900] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:28 2022] PUT /identity/v3/projects/2afed941475c4d9f9a113a9922027649/users/0fed525003294b819d27a6412ca75073/roles/8689bf0d70184aef9148c6b4a9758b32 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:28.861868 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430fb42-8ac9-4221-9874-5d9b064f7760 None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:28.862157 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430fb42-8ac9-4221-9874-5d9b064f7760 None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:28.862433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430fb42-8ac9-4221-9874-5d9b064f7760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:28.891444 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-8430fb42-8ac9-4221-9874-5d9b064f7760 None None] MFA Rules not processed for user `0fed525003294b819d27a6412ca75073`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:28.892663 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8430fb42-8ac9-4221-9874-5d9b064f7760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:28.967672 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1430/2901] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:57:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:28.977512 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bda53-74bd-4005-b6e7-7c3ab371b3fb admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:28.980408 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-087bda53-74bd-4005-b6e7-7c3ab371b3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:29.041208 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bda53-74bd-4005-b6e7-7c3ab371b3fb admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:29.045102 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ada5e2-987e-4541-b3cb-d480211636cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '380240bcfca240a2b4969f6618409a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:29.045802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ada5e2-987e-4541-b3cb-d480211636cb service cinder] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:29.046107 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ada5e2-987e-4541-b3cb-d480211636cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:29.046392 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ada5e2-987e-4541-b3cb-d480211636cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:29.055584 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ada5e2-987e-4541-b3cb-d480211636cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:29.057133 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ada5e2-987e-4541-b3cb-d480211636cb service cinder] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:29.068441 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1472/2902] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:37.623294 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430fb42-8ac9-4221-9874-5d9b064f7760 None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:37.624794 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-8430fb42-8ac9-4221-9874-5d9b064f7760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:37.666241 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:37.684064 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430fb42-8ac9-4221-9874-5d9b064f7760 None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:37.692642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc822b-4588-4a80-9327-347c10a91af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:37.692642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc822b-4588-4a80-9327-347c10a91af6 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:37.692642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc822b-4588-4a80-9327-347c10a91af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:37.692642 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc822b-4588-4a80-9327-347c10a91af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:37.693034 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-48fc822b-4588-4a80-9327-347c10a91af6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:37.757293 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc822b-4588-4a80-9327-347c10a91af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:37.758742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc822b-4588-4a80-9327-347c10a91af6 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:37.769084 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1431/2903] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:39.062451 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=67,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:41.132840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ada5e2-987e-4541-b3cb-d480211636cb service cinder] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:41.199944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ada5e2-987e-4541-b3cb-d480211636cb service cinder] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:41.204539 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:41.205182 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:41.205465 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:41.205741 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] PATH_INFO: `/v3/users/0fed525003294b819d27a6412ca75073` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:41.206870 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fed525003294b819d27a6412ca75073)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:41.208844 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:41.438445 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fed525003294b819d27a6412ca75073'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:41.439132 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fed525003294b819d27a6412ca75073'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:41.439752 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fed525003294b819d27a6412ca75073'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:41.569326 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fed525003294b819d27a6412ca75073'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:41.583309 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fed525003294b819d27a6412ca75073'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:41.595547 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1473/2904] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:41 2022] DELETE /identity/v3/users/0fed525003294b819d27a6412ca75073 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:41.600070 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1394840-bee1-4dfc-b629-5aeb70e7e1bd None None] REQUEST_METHOD: `POST` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:41.600628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1394840-bee1-4dfc-b629-5aeb70e7e1bd None None] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:41.600628 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1394840-bee1-4dfc-b629-5aeb70e7e1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:41.619304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.auth.core [None req-d1394840-bee1-4dfc-b629-5aeb70e7e1bd None None] MFA Rules not processed for user `360b6abf2f0e4fd18bda140d1e9c6378`. Rule list: `[]` (Enabled: `True`). {{(pid=81855) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:41.620526 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d1394840-bee1-4dfc-b629-5aeb70e7e1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:41.679415 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1432/2905] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 03:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:41.702092 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:41.704147 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:41.760743 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb013ed4-b499-490f-9c21-b4f1b3d5daa1 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:41.765398 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b86280-6734-4884-87b1-859137ca5692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:41.766007 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b86280-6734-4884-87b1-859137ca5692 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:41.766289 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b86280-6734-4884-87b1-859137ca5692 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:41.766564 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b86280-6734-4884-87b1-859137ca5692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:41.775757 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b86280-6734-4884-87b1-859137ca5692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:41.777202 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b86280-6734-4884-87b1-859137ca5692 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:41.786865 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1474/2906] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:42.232551 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1394840-bee1-4dfc-b629-5aeb70e7e1bd None None] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:42.236145 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d1394840-bee1-4dfc-b629-5aeb70e7e1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:42.250947 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1394840-bee1-4dfc-b629-5aeb70e7e1bd None None] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:42.257186 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:42.258001 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:42.258301 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:42.258481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] PATH_INFO: `/v3/projects/2afed941475c4d9f9a113a9922027649` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:42.259743 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2afed941475c4d9f9a113a9922027649)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:42.261785 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:42.398093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2afed941475c4d9f9a113a9922027649', 'request_id': 'req-04beb191-3b3a-45e7-8789-1438c5fcab9c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:42.403843 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2afed941475c4d9f9a113a9922027649', 'request_id': 'req-04beb191-3b3a-45e7-8789-1438c5fcab9c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:42.471216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2afed941475c4d9f9a113a9922027649', 'request_id': 'req-04beb191-3b3a-45e7-8789-1438c5fcab9c'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:42.484134 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] The token cache is being invalidate because project 2afed941475c4d9f9a113a9922027649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81855) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:42.484363 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:42.485007 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:42.486519 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1433/2907] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:42 2022] DELETE /identity/v3/projects/2afed941475c4d9f9a113a9922027649 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:51.782526 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:52.480088 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:20.442701 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b86280-6734-4884-87b1-859137ca5692 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:20.452489 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b86280-6734-4884-87b1-859137ca5692 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:20.505896 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae1ae3-2d98-421b-9da5-a0f4be9902e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:20.507500 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae1ae3-2d98-421b-9da5-a0f4be9902e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:20.508051 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae1ae3-2d98-421b-9da5-a0f4be9902e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:20.508520 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae1ae3-2d98-421b-9da5-a0f4be9902e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:20.510792 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-63ae1ae3-2d98-421b-9da5-a0f4be9902e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:20.521459 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae1ae3-2d98-421b-9da5-a0f4be9902e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:20.522916 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae1ae3-2d98-421b-9da5-a0f4be9902e3 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:20.531439 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1475/2908] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:30.527458 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=26 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:34.878278 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:34.879814 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:34.894104 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beb191-3b3a-45e7-8789-1438c5fcab9c admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:34.898435 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a0572-93e9-4775-9242-846fc0c93abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:34.899276 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a0572-93e9-4775-9242-846fc0c93abd service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:34.899566 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a0572-93e9-4775-9242-846fc0c93abd service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:34.899835 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a0572-93e9-4775-9242-846fc0c93abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:34.901576 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-b62a0572-93e9-4775-9242-846fc0c93abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:34.982304 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a0572-93e9-4775-9242-846fc0c93abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:34.984627 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a0572-93e9-4775-9242-846fc0c93abd service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:35.001591 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1434/2909] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:36.187785 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae1ae3-2d98-421b-9da5-a0f4be9902e3 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:36.197473 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae1ae3-2d98-421b-9da5-a0f4be9902e3 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:36.201135 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d4b4e-b8bb-4345-929b-a3e94f9ddc45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:36.201739 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4b4e-b8bb-4345-929b-a3e94f9ddc45 service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:36.202024 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4b4e-b8bb-4345-929b-a3e94f9ddc45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:36.202301 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4b4e-b8bb-4345-929b-a3e94f9ddc45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:36.204057 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a25d4b4e-b8bb-4345-929b-a3e94f9ddc45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:36.217900 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d4b4e-b8bb-4345-929b-a3e94f9ddc45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:36.219373 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d4b4e-b8bb-4345-929b-a3e94f9ddc45 service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:36.230768 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1476/2910] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:44.993910 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=34 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:46.225958 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:48.145808 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a0572-93e9-4775-9242-846fc0c93abd service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:48.155746 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a0572-93e9-4775-9242-846fc0c93abd service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:48.159548 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec557a-cc95-4440-ad06-fa93f4356780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:48.160147 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec557a-cc95-4440-ad06-fa93f4356780 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:48.160428 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec557a-cc95-4440-ad06-fa93f4356780 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:48.160701 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec557a-cc95-4440-ad06-fa93f4356780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:48.162441 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-ceec557a-cc95-4440-ad06-fa93f4356780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:48.172017 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec557a-cc95-4440-ad06-fa93f4356780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:48.173438 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec557a-cc95-4440-ad06-fa93f4356780 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:48.181998 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1435/2911] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:49.558367 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d4b4e-b8bb-4345-929b-a3e94f9ddc45 service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:49.562919 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-a25d4b4e-b8bb-4345-929b-a3e94f9ddc45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:49.571644 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d4b4e-b8bb-4345-929b-a3e94f9ddc45 service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:49.575441 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277b821-1298-4d93-aef6-0f48bc68e64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:49.576079 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277b821-1298-4d93-aef6-0f48bc68e64f service neutron] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:49.576490 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277b821-1298-4d93-aef6-0f48bc68e64f service neutron] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:49.576760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277b821-1298-4d93-aef6-0f48bc68e64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:49.578505 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4277b821-1298-4d93-aef6-0f48bc68e64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:49.588677 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277b821-1298-4d93-aef6-0f48bc68e64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:49.590129 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277b821-1298-4d93-aef6-0f48bc68e64f service neutron] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:49.598778 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1477/2912] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:50.683952 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec557a-cc95-4440-ad06-fa93f4356780 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:50.692795 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec557a-cc95-4440-ad06-fa93f4356780 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:50.697131 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4d240-971f-43da-a266-802254045be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4ab7a3b191e4a0b84b396cafa8a9ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:50.697736 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d240-971f-43da-a266-802254045be2 service neutron] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:50.698012 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d240-971f-43da-a266-802254045be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:50.698281 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d240-971f-43da-a266-802254045be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:50.700051 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9bd4d240-971f-43da-a266-802254045be2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:50.714261 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4d240-971f-43da-a266-802254045be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:50.715742 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4d240-971f-43da-a266-802254045be2 service neutron] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:50.727117 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1436/2913] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:50.815724 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277b821-1298-4d93-aef6-0f48bc68e64f service neutron] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:50.817399 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-4277b821-1298-4d93-aef6-0f48bc68e64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:50.892619 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277b821-1298-4d93-aef6-0f48bc68e64f service neutron] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:50.897687 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fce6b8-04f8-4ea1-871e-c4beeb9d699b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:50.898304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fce6b8-04f8-4ea1-871e-c4beeb9d699b service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:50.898587 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fce6b8-04f8-4ea1-871e-c4beeb9d699b service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:50.899570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fce6b8-04f8-4ea1-871e-c4beeb9d699b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:50.901384 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-34fce6b8-04f8-4ea1-871e-c4beeb9d699b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:50.912845 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fce6b8-04f8-4ea1-871e-c4beeb9d699b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:50.914456 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fce6b8-04f8-4ea1-871e-c4beeb9d699b service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:50.924412 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1478/2914] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:51.545618 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4d240-971f-43da-a266-802254045be2 service neutron] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:51.547216 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9bd4d240-971f-43da-a266-802254045be2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:51.561160 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4d240-971f-43da-a266-802254045be2 service neutron] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:51.571014 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02df36-987b-44d8-9776-b4c281a1877e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:51.571014 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02df36-987b-44d8-9776-b4c281a1877e service nova] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:51.571014 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02df36-987b-44d8-9776-b4c281a1877e service nova] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:51.571014 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02df36-987b-44d8-9776-b4c281a1877e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:51.572332 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9b02df36-987b-44d8-9776-b4c281a1877e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:51.583487 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02df36-987b-44d8-9776-b4c281a1877e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:51.585097 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02df36-987b-44d8-9776-b4c281a1877e service nova] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:51.596425 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1437/2915] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:00.920205 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=38 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:01.591959 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=18 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:17.796482 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fce6b8-04f8-4ea1-871e-c4beeb9d699b service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:17.810316 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fce6b8-04f8-4ea1-871e-c4beeb9d699b service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:17.817406 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cd3c8-a47e-43f8-8c50-a26761287a93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9624bc4b2840420eb06d721a73655da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:17.818076 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cd3c8-a47e-43f8-8c50-a26761287a93 service nova] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:17.818499 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cd3c8-a47e-43f8-8c50-a26761287a93 service nova] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:17.818771 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cd3c8-a47e-43f8-8c50-a26761287a93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:17.821352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-181cd3c8-a47e-43f8-8c50-a26761287a93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:17.837164 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cd3c8-a47e-43f8-8c50-a26761287a93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:17.843243 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cd3c8-a47e-43f8-8c50-a26761287a93 service nova] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:17.856554 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1479/2916] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:27.804184 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02df36-987b-44d8-9776-b4c281a1877e service nova] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:27.805681 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-9b02df36-987b-44d8-9776-b4c281a1877e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:27.821006 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02df36-987b-44d8-9776-b4c281a1877e service nova] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:27.826386 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d40c6-05f5-42d9-8371-2f55fa09eee4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:27.827074 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d40c6-05f5-42d9-8371-2f55fa09eee4 service placement] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:27.827361 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d40c6-05f5-42d9-8371-2f55fa09eee4 service placement] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:27.827634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d40c6-05f5-42d9-8371-2f55fa09eee4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:27.829447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-764d40c6-05f5-42d9-8371-2f55fa09eee4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:27.845272 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d40c6-05f5-42d9-8371-2f55fa09eee4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:27.846983 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d40c6-05f5-42d9-8371-2f55fa09eee4 service placement] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:27.850840 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=6 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:27.859148 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1438/2917] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:31.282095 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cd3c8-a47e-43f8-8c50-a26761287a93 service nova] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:31.294000 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cd3c8-a47e-43f8-8c50-a26761287a93 service nova] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:31.299306 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a3fa8-af49-4ae1-ae8c-a4e551fdc126 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:31.299944 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3fa8-af49-4ae1-ae8c-a4e551fdc126 service placement] REQUEST_METHOD: `GET` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:31.300230 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3fa8-af49-4ae1-ae8c-a4e551fdc126 service placement] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:31.300509 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3fa8-af49-4ae1-ae8c-a4e551fdc126 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:31.302287 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-f93a3fa8-af49-4ae1-ae8c-a4e551fdc126 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:31.314779 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a3fa8-af49-4ae1-ae8c-a4e551fdc126 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:31.317363 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a3fa8-af49-4ae1-ae8c-a4e551fdc126 service placement] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:31.326761 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1480/2918] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:31.408668 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d40c6-05f5-42d9-8371-2f55fa09eee4 service placement] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:31.410240 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-764d40c6-05f5-42d9-8371-2f55fa09eee4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:31.477780 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d40c6-05f5-42d9-8371-2f55fa09eee4 service placement] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:31.482550 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:31.483206 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:31.483481 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:31.483748 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] PATH_INFO: `/v3/users/c7299595b81340298789792e00b2bfaa` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:31.484864 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7299595b81340298789792e00b2bfaa)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:31.486770 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:31.691447 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7299595b81340298789792e00b2bfaa'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:31.738433 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7299595b81340298789792e00b2bfaa'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:31.746338 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7299595b81340298789792e00b2bfaa'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:31.746981 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7299595b81340298789792e00b2bfaa'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:31.759773 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7299595b81340298789792e00b2bfaa'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:31.765754 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1439/2919] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 04:01:31 2022] DELETE /identity/v3/users/c7299595b81340298789792e00b2bfaa => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:01:31.998537 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a3fa8-af49-4ae1-ae8c-a4e551fdc126 service placement] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:32.009248 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a3fa8-af49-4ae1-ae8c-a4e551fdc126 service placement] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:32.069423 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:32.070067 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:32.070352 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:32.070630 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] PATH_INFO: `/v3/projects/f828fccb789942e4b2805727c4d2841a` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:32.071802 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f828fccb789942e4b2805727c4d2841a)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:32.073721 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:32.174093 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f828fccb789942e4b2805727c4d2841a', 'request_id': 'req-20801c5f-f8a2-4cd6-8c87-f26859456549'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:32.252971 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f828fccb789942e4b2805727c4d2841a', 'request_id': 'req-20801c5f-f8a2-4cd6-8c87-f26859456549'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:32.259025 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f828fccb789942e4b2805727c4d2841a', 'request_id': 'req-20801c5f-f8a2-4cd6-8c87-f26859456549'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:32.270277 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] The token cache is being invalidate because project f828fccb789942e4b2805727c4d2841a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:01:32.270570 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:32.271233 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:32.280397 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1481/2920] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 04:01:31 2022] DELETE /identity/v3/projects/f828fccb789942e4b2805727c4d2841a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:01:32.280522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:32.280522 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:32.292720 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2c0f1-5b28-4ad9-83c0-38a345465b71 admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:32.348986 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:32.349617 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:32.349898 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:32.350737 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] PATH_INFO: `/v3/users/5ac587b5a69e492bae8dd42007d2e132` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:32.351917 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac587b5a69e492bae8dd42007d2e132)` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:32.353834 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:32.359173 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:32.546783 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac587b5a69e492bae8dd42007d2e132'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:32.624500 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac587b5a69e492bae8dd42007d2e132'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:32.633032 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac587b5a69e492bae8dd42007d2e132'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:32.633901 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac587b5a69e492bae8dd42007d2e132'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:32.646686 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.notifications [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac587b5a69e492bae8dd42007d2e132'} {{(pid=81855) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:32.653539 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1440/2921] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 04:01:32 2022] DELETE /identity/v3/users/5ac587b5a69e492bae8dd42007d2e132 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:01:32.889201 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] Authenticating user token {{(pid=81854) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:32.890704 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.fernet_utils [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81854) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:32.906598 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20801c5f-f8a2-4cd6-8c87-f26859456549 admin admin] Validating token access rules against request {{(pid=81854) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:32.967661 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '360b6abf2f0e4fd18bda140d1e9c6378', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c938bc0d4468aba227f5962adcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81854) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:32.968474 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:32.968760 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:32.969060 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] PATH_INFO: `/v3/projects/a42313e500a349aeb8e154b129089ac3` {{(pid=81854) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:32.970313 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42313e500a349aeb8e154b129089ac3)` {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:32.972396 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] RBAC: Authorization granted {{(pid=81854) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:32.999415 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:33.092591 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42313e500a349aeb8e154b129089ac3', 'request_id': 'req-93709504-0ff6-4d20-967f-b2afd067f56a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:33.144084 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42313e500a349aeb8e154b129089ac3', 'request_id': 'req-93709504-0ff6-4d20-967f-b2afd067f56a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:33.149834 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42313e500a349aeb8e154b129089ac3', 'request_id': 'req-93709504-0ff6-4d20-967f-b2afd067f56a'} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:33.161404 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] The token cache is being invalidate because project a42313e500a349aeb8e154b129089ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81854) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:01:33.161698 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:33.162799 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG keystone.notifications [None req-93709504-0ff6-4d20-967f-b2afd067f56a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81854) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:01:33.164304 dv-cinder-854262-1-smb devstack@keystone.service[81854]: [pid: 81854|app: 0|req: 1482/2922] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 04:01:32 2022] DELETE /identity/v3/projects/a42313e500a349aeb8e154b129089ac3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:01:42.650540 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:43.158251 dv-cinder-854262-1-smb devstack@keystone.service[81854]: DEBUG dbcounter [-] [81854] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:21.694608 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] Authenticating user token {{(pid=81855) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:21.696048 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:21.765819 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c85900-9b09-4c2e-bb9c-d5bec5e9765e admin admin] Validating token access rules against request {{(pid=81855) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:21.826328 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c087f5-05f3-4605-bf88-0bf8dc26a6b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e686e974721345eba4de46cde2edaf34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e91374ed79e432c98e3e851e544a59a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81855) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:21.826949 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c087f5-05f3-4605-bf88-0bf8dc26a6b5 service placement] REQUEST_METHOD: `GET` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:21.827253 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c087f5-05f3-4605-bf88-0bf8dc26a6b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:21.827524 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c087f5-05f3-4605-bf88-0bf8dc26a6b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81855) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:21.829269 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.fernet_utils [None req-41c087f5-05f3-4605-bf88-0bf8dc26a6b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81855) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:21.841634 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c087f5-05f3-4605-bf88-0bf8dc26a6b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:21.843271 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c087f5-05f3-4605-bf88-0bf8dc26a6b5 service placement] RBAC: Authorization granted {{(pid=81855) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:21.853496 dv-cinder-854262-1-smb devstack@keystone.service[81855]: [pid: 81855|app: 0|req: 1441/2923] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 04:02:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:02:31.849093 dv-cinder-854262-1-smb devstack@keystone.service[81855]: DEBUG dbcounter [-] [81855] Writing DB stats keystone:SELECT=58 {{(pid=81855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}